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Performance of Burst-Trapping Codes 


By S. Y. TONG 
(Manuscript received November 6, 1969) 


The performance of several burst-trapping codes has been estimated 
through computer simulation on three sets of field trial data over the switched 
telephone network (Alexander-Gryb-Nast, Townsend-Watts, V estigial-Side- 
band). The results indicate that the codes are capable of giving better per- 
formance than interleaved codes based on the same coding redundancy and 
approximately the same storage requirement. 


I. INTRODUCTION 


An adaptive error control scheme called burst-trapping has been 
proposed as a means to combat errors in a channel where both random 
and burst disturbances occur.” Such a channel is called a compound 
channel. Error statistics derived from field trial data over telephone 
channels indicate that the switched telephone network is a prime ex- 
ample of a compound channel. 

It is of interest to see how the proposed technique performs on 
telephone channels and to compare its performance with other known 
techniques. In this report, a computer simulation is used to determine 
the performance of such codes. A program has been written which simu- 
lates any burst-trapping code of rate (6 — 1)/b, ban integer. The program 
was used on the three well-known sets of telephone error data: the 
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Alexander-Gryb-Nast (AGN) data,’ the Townsend-Watts (TW) data® 
and the Vestigial-Sideband (VSB) data.* 

The output of the simulation program gives both the bit and block 
error rate before and after the application of burst-trapping error con- 
trol. The simulated block error rate with a large interleaving degree 
shows an excellent agreement with the result of an analytical approach 
presented in the companion paper.’ Since two independent approaches 
are used, the agreement seems to indicate both techniques are accurate. 
The analytical technique gives the tail of distribution which cannot 
be produced by the simulation without a large amount of raw data. 
On the other hand, the simulation technique can show the effect of 
interleaving on performance. Thus it is a valuable design tool to deter- 
mine the size of interleaving required which in turn determines the 
cost of the error control system. (Note that in Ref. 5, interleaving is 
assumed to be sufficiently large that each subcode essentially has sta- 
tistically independent error blocks.) Thus these two techniques com- 
plement each other for the evaluation of performance of a burst-trapping 
code. 


II. A REVIEW OF BURST-TRAPPING CODES 


The reader is assumed to be familiar with Ref. 1 on burst-trapping 
techniques. We shall therefore confine ourselves to a brief review and 
will restrict our attention to codes with rate R = 2, as this is the lowest 
rate that reveals the general operation. For a general description, see 
Ref. 1. 

Let C be a linear systematic binary block code of length n with k 
information bits per block, such that k/n = 3. Let I; be a k/2-tuple 
representing the first k/2 information bits in the 7th transmitted block 
and let I~ be similarly defined for the second k/2 information bits. Let 
P, be the parity digits in the code word associated with J; and J. 
(Note that P; is also a k/2-tuple.) Finally, define Q; as 


02:2 P;4+.4,+ R., 


where addition is bit-by-bit, modulo-2. Then the transmitted message 
consists of the sequence of k/2-tuples, I}, 727, Q., J}, 7, Q1, °°: ; 
T,, T, Q:, +++ , and so on, as shown in Fig. 1. 

At the decoder there are two modes of operation, the random mode 
and the burst-trapping mode. Let the minimum distance of C be d,, 
and assume that the decoder is designed to correct up to ¢ errors per 
block where ¢ S [(d,, — 1)/2]. Now assume the decoder has just received 
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Fig. 1—Generation of R = 2/3 burst-trapping code. 


the Oth block. If Ji = 0,7 < 0,7 = 1, 2, then Q) = P, and the sequence 
Ii, 2, Qo forms a code word in C. If the decoder ‘‘thinks” that there 
are ¢ or fewer errors in the received block, then it operates in the random 
mode and attempts to correct these errors. If the decoder is successful 
then J} can be subtracted from Q, and Jj from Q. through feedback as 
shown in Fig. 2. As long as decoding proceeds correctly in this fashion, 
then, upon the arrival of each successive block, the effect of all past 
information bits will be removed and the decoder will be left with a 
code word in C plus any channel errors which may have occurred. 
Thus, in the random mode, the decoder acts like an ordinary block 
decoder. Let us now assume that at the first block the decoder detects 
an error pattern of weight greater than ¢. It then enters the burst- 
trapping mode, inhibits feedback of the information bits and delays the 
estimation of Ij and J} until the second and third blocks have arrived. 
The course of action then taken by the decoder is shown graphically in 
Fig. 3. If the second block is correctly received, then P2 can be calculated 
































Ij fetes [3 | Pe 15 | 1§) Psa] eee 
ee | 


12 |e 


E 














Fig. 2—Error correction in random code. 
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Fig. 83—Error correction in burst code. 


from J} and I} and subtracted from Q,. Assuming that the Oth block 
has been correctly decoded, Jj may also be subtracted from Q, , leaving 
I, which replaces the first k/2 discarded information bits in the first 
block. If the third block is also correctly received, then J} and I} may 
be used to calculate P; which, along with Jj , is subtracted from Q; , 
leaving [7 which, in turn, replaces the second k/2 discarded information 
bits in the first block. Thus J; and J} will be recovered error-free if and 
only if the second and third blocks are error-free. This is the guard space 
for correcting a burst in the first block. To summarize this discussion, 
a block error pattern which is detectable with C is correctable with the 
burst-trapping decoder if and only if the next two blocks are error-free. 
The probability of failing to detect an error can be made small by keeping 
t small. In such a case, most of the cosets of C are used for detection, with 
only a few being used for correction. Such a strategy is often successful on 
channels where the probability of error between bursts is quite low. 

As with any feedback convolutional decoding algorithm, this dis- 
cussion is valid only under the assumption that all previous blocks have 
been decoded correctly. In the event of a decoding error, it has been 
shown that error propagations are rare and are limited." Now suppose 
Q; is redefined as 


Q,2P,+ Tet Tien. 


Then the code is said to be block-interleaved to degree ¢. In the burst 
trapping mode, the decoder then recovers J} and J? from the (¢ + £)th 
and the (¢ + 2¢)th blocks, respectively. Interleaving produces, in 
effect, ¢ distinct codes of the type described before and if a burst is 
limited to ¢ or fewer blocks, only one block in each code will be affected. 
It follows that a burst confined to ¢ successive blocks is correctable if 
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(z) no undetected errors occur in any of the ¢ blocks and (zz) the next 
2¢ blocks are error-free. The latter condition is not a necessary one 
since many burst patterns, particularly on telephone channels, will 
contain blocks with ¢ or few errors. If this is true for, say, the kth block, 
then the (k + £)th and (k + 2¢)th blocks need not be error free. 

In the next section, the simulation results on bit error rates are given. 
It is shown that the burst-trapping codes, when used on telephone 
channels, seem to perform better than other known codes, with the 
same coding redundancy and same storage requirement. 


III. SIMULATION RESULTS 


AGN data was collected over the nation-wide switched network in 
1959 with an FM data set operating at 600 b/s and 1200 b/s. Data 
from a total of about 1000 calls were recorded. The distribution of the 
average bit error per call is reproduced in Fig. 4. As will be shown later, 
the burst-trapping codes used in the test correct all the errors in at 
least 95 percent of the calls. Since the distribution of calls above 90 
percent level is almost identical for both 600 and 1200 b/s calls, it was 
decided to combine the two types of calls together to simplify the dis- 
cussion. 

TW data was collected at 2000 b/s. A DATAPHONE 201A modem 
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Fig. 4—Alexander-Gryb-Nast raw data statistics. Distribution of calls with 
respect to bit error rate and speed. Total number of calls—1000. 
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was used. A total of 502 usable calls* was recorded. The statistics of the 
calls are reproduced in Fig. 5. 

VSB data used in this report consists of 85 selected calls. The statistics 
of the calls are shown in Fig. 6. 
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Fig. 5—Townsend-Watts (TW) raw data statistics. Distribution of calls with 
respect to bit error rate. Total number of calls = 502. 


To simplify discussion, a quintuple (n, k, d,, , t, £) is used to describe 
each burst-trapping code. Recall that a burst-trapping code is built on 
the basis of a (n, k, d,,) block code, where 7 is the block length, k is the 
number of information bits per block and d,, is the minimum distance 
of the block code. The parameter ¢ denotes the number of random errors 
the burst-trapping decoder is designed to correct and ¢ is the interleaving 
degree. Roughly, with a (n, k, d,,, t, £) burst-trapping code one may 
either correct ¢ random errors in 7 bits or up to an né-bit burst provided 
that a guard space of n’¢/(n — k) bits exists. The storage requirement is 
nkt/(n — k) + n + ¢ bits. For more details, please refer to Ref. 1. 

Figure 7 compares the performance of two rate } codes on VSB data: 
a (24, 12) triple-error-correcting extended Golay code interleaved to 


* Reference 3 indicates 548 completed calls. However, Ref. 6 indicates 503 com- 
pleted calls of which 136 were error-free and 367 contained errors. The data available 
on magnetic tape and used in this study are consistent with the number of calls in 
Ref. 6 with the exception that one call was uninterpretable. Therefore, we shall 
use the calls from Ref. 6 with the exception of the aforementioned call leaving our 
sample to be of 502 calls of which 136 were error-free. (Courtesy of Messrs. F. X. 
Brophy and M. M. Buchner, Jr.) 
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Fig. 6—Raw data statistics for multilevel Vestigial-Sideband (VSB) modem—with 
respect to bit error rate. Total number of calls = 85. 
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Fig. 7—Comparison of rate 1/2 codes. (a) (24, 12, 8, 1, 330) burst-trapping code. 
ane (24, 12) Golay code corrects single random error and burst up to 7920 bits. 
Storage = 4214 bits. (b) Interleaved (24, 12) extended Golay code corrects three 
errors. Interleaving degree = 175. Corrects bursts up to 525 bits. Storage = 4200, 
(c) VSB raw data, 
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degree 175 and a burst-trapping code based on the same Golay code but 
with single-error-correction only. As shown in the figure, their storage 
requirements are about the same; yet the (24, 12, 8, 1, 8330) burst-trap- 
ping code out-performs the interleaved Golay code at a significantly 
lower cost (single-error correction vs. triple-error correction). 

Figure 8 compares the performance of two rate 2 codes: a (57, 38) 
triple-error-correcting shortened BCH code interleaved to degree 75 


100 
90 
80 
70 
60 
50 


40 





PERCENTAGE OF CALLS HAVING ERROR RATE 
EQUAL OR BETTER THAN THE ABSCISSA VALUE 


2 5 


2 5 2 5 2 S 


1075 1074 i073 


BIT ERROR RATE 


Fig. 8—Comparison of two rate 2/3 codes. (a) (57, 38, 8, 2, 50) burst-trapping 
code. Using (57, 38) BCH code corrects 2 random errors and bursts up to 2850 bits. 
Storage = 3957 bits. (b) Interleaved (57, 38) BCH code corrects three errors and 
bursts of 275 bits. Storage = 4275 bits. Interleaving degree = 75. (c) VSB raw data. 


and a (57, 38, 8, 2, 50) burst-trapping code. Figure 9 also compares 
two rate-$codes: an interleaved (degree 25) (255,170) compound code* 
that corrects seven random errors and bursts of 1000 bits (after inter- 
leaving) and a (126, 84, 14, 6, 25) burst-trapping code. It is seen, that 
the burst-trapping code outperforms the compound code at smaller 
storage requirement and lower logic cost (six error vs. seven error cor- 
recting). A more striking result is shown in Fig. 10, where the per- 
formance of the (255, 170) compound code is compared with a (89, 26, 
6, 1, 117) burst-trapping code, which performs better than the com- 
pound code; yet only single-error-correction is required (vs. seven error 


* Taken from page 137 Table 1 of Ref. 7. 
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Fig. 9—(255, 170) compound code vs. (126, 84, 14, 6, 25) burst-trapping code. 
(a) (126, 84, 14, 6, 25) burst-trapping code using (126, 84) BCH code corrects 
6 random errors and bursts up to 3150 bits. Storage required = 4376 bits. (b) Inter- 
leaved (255, 170) compound code that corrects 7 random errors and 1000-bit burst 
fs with interleaving degree 25. Storage required = 6375 bits. (c) VSB raw 

ata. 


correction required for the compound code). Note that the compound 
code chosen is a very powerful one. The comparison simply shows that 
this type of code might not be suitable for use on telephone channels. 

Figure 11 shows the effect of the trade-off between random-error- 
correction and burst-error-correction for a typical burst-trapping code. 
In this case, a (57, 38) BCH code was used to correct 0, 1, 2 and 3 
errors with correspondingly decreasing burst-error-detecting capability 
and consequently lower burst-correcting capability. 

The (57, 38, 8, 0, 50) is simply a burst-error-correcting code. Its 
performance reflects the fact that telephone channels do not produce 
burst errors only. The (57, 38, 8, 8, 50) code is essentially a random- 
error-correcting code. Such a code, as expected, does not do well for 
telephone channels either. The (57, 38, 8, 1, 50) single-error-correcting 
and the (57, 88, 8, 2, 50) double-error-correcting burst-trapping codes 
perform better. This seems to confirm the assertion that telephone chan- 
nels can be characterized as a type of compound channel. 

Figures 12 through 16 show the performance of various burst-trapping 
codes on AGN and TW data. It is seen that more than 93 percent of. 
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Fig. 10—(255, 170) compound code vs. (39, 26, 6, 1, 117) burst-trapping code. 
(a) (89, 26, 6, 1, 117) burst-trapping code which corrects single error and bursts 
up to 4563 bits. Storage required = 6357 bits. (b) Interleaved (255, 170) compound 
code which corrects 7 random errors and 1000-bit burst errors with interleaving 
degree 25. Storage required = 6375 bits. (c) VSB raw data. 
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Fig. 11—Effect of trade off on VSB channels. Burst-trapping code using (57, 38) 


code with different mix of random and burst-error-correcting capability. Inter- 
leaving degree L = 50. Storage = 3957 bits. 
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Fig. 12—Performance of two burst-trapping codes over AGN data. (a) (57, 38, 
8, 2, 50) burst-trapping code corrects burst up to 2650 bits. Storage required = 
3957 bits. (b) (57, 38, 8, 2, 26) burst-trapping code corrects bursts up to 1482 bits. 
Storage required = 2085 bits. (c) AGN raw data. 
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Fig. 13—Performance of (30, 20, 5, 1, 50) burst-trapping code. (a) (30, 20, 5, 1, 50) 
burst-trapping code corrects single error and bursts up to 1500 bits. Storage re- 
quired = 2130 bits. (b) AGN raw data. 
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Fig. 14—Performance of (57, 38, 8, 2, 26) burst-trapping code over TW data. (a) 
(57, 38, 8, 2, 26) burst-trapping code corrects double errors and bursts up to 1482 bits. 
Storage required = 2085 bits. (b) TW raw data. 
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Fig. 15—Performance of two burst-trapping codes over TW data. (a) (89, 26, 6, 1, 
80) burst-trapping code corrects burst up to 3120 bits. Storage required = 4379 bits. 
(b) (39, 26, 6, 1, 40) burst-trapping code corrects burst up to 1560 bits. Storage 
required = 2199 bits. (c) TW raw data. 
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Fig. 16—Performance of (39, 26, 6, 1, 80) burst-trapping code. (a) (389, 26, 6, 1, 80) 
burst-trapping code corrects single error and bursts up to 3120 bits. Storage re- 
quired = 4359 bits. (b) AGN raw data. 


calls will be error-free if any of these codes is used for error control. 
All can be implemented at very modest cost. 

Finally, we compare the performance of a (24, 20) convolutional 
single-error-correcting code interleaved to degree 127 with a burst- 
trapping code. The interleaved (24, 20) code is planned to be used in 
an optional error control unit for the 203 data set.**? The performance 
of the (24, 20) code has been simulated by W. K. Pehlert with VSB 
data.” 

Figure 17 curve (a) shows the performance of a (90, 75, 6, 1, 8) burst- 
trapping code with the same data; this code requires about the same 
storage* and has the same rate but performs better than (24, 20) code. 
Figure 17 curve (c) shows a more contrasting comparison. The (90, 75, 6, 
1, 6) burst-trapping code requires only three-quarters as much storage 
yet still performs about the same as (24, 20) code. Before one attempts to 
draw any conclusion, however, it must be emphasized that the result 
is based on a relatively small sample size; hence wide variations are 
expected. 


* We assume the (24, 20) code uses minimum storage, that is, 3048 bits although 
the ecuet implementation uses about 3600 bits of storage in order to simplify decod- 
ing logic. 
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Fig. 17—Comparison of rate 5/6 error-correcting codes. (a) (90, 75, 6, 1, 8) burst- 
trapping code corrects burst up to 720 bits. Storage required = 3000 bits. (b) (24, 
20) single error correcting code interleaved to degree 127. Corrects bursts up to 
127 bits. Storage required = 3000 bits. (c) (90, 75, 6, 1, 6) burst-trapping code cor- 
rects bursts up to 540 bits. Storage required = 2250 bits. (d) VSB raw data. 


IV. CONCLUSION 


We have shown, through computer simulation, the performance of 
some burst-trapping codes, and have compared such codes with other 
known codes using telephone channel error statistics. It seems that 
several conclusions can be drawn, based on the available data. 


(t) There are always a few percent of the calls that are so bad that it 
is difficult to improve them through forward error-control. 
(iz) The performance of burst-trapping codes compares favorably with 
interleaved codes. 
(itz) For a given level of performance, burst-trapping decoders are 
generally simpler to implement than decoders for other schemes 
that have been proposed for telephone channels. 
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Analysis of a Burst-Trapping Error 


Correction Procedure 


By W. K. PEHLERT, JR. 
(Manuscript received November 6, 1969) 


This paper presents an analysis technique for determining upper and 
lower bounds on the performance of a burst-trapping error control pro- 
cedure. The analysis is valid for random, burst, or compound channels 
provided that a block interleaving degree £ = 1 can be found for the channel 
such that error patterns in blocks spaced £ blocks apart occur approximately 
independently. Good agreement is achieved between the theoretical per- 
formance of codes on telephone channels and the performance obtained by 
computer simulation. 


I. INTRODUCTION 


A burst-trapping error correction procedure for error control on 
compound channels such as the telephone channel has been described 
by 8S. Y. Tong.’ An evaluation of the burst-trapping procedure by 
computer simulation of its performance on recorded telephone channel 
error data is presented in the companion paper.” An analysis technique 
for determining the performance of the burst-trapping procedure is 
presented here. The analysis technique permits determination of upper | 
and lower bounds on the probability of block error. It is valid for random, 
burst, or compound channels provided that a block interleaving degree 
£ = 1 can be found for the channel such that error patterns in blocks 
spaced ¢ blocks apart occur (approximately) independently. 

Expressions for upper and lower bounds on the probability of block 
error for codes of rate } and § are given in Table I. For higher rate codes, 
numerical determination of the stationary probabilities which yield 
the bounds seems preferable to determination of expressions for the 
bounds. The performance of a rate 2 code, the (39, 26) shortened BCH 
code, has been computed using the expressions for probability of block 
error of Table I for two sets of recorded telephone channel error data. 
For both sets of data the computed performance agrees well with the 
performance obtained by computer simulation. 
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II. ENCODING AND BURST-TRAPPING DECODING PROCEDURES 


The encoding procedure and burst-trapping decoding technique have 
been described in detail elsewhere.’ The code is a rate (b — 1)/b recurrent 
code*® whose parity check matrix, A, is constructed from the parity check 
matrix, H, of an (n, k) linear systematic block code [where k/n = 
(b — 1)/b] and the (n — k) X (n — k) identity matrix J. The truncated 
parity check matrix, Ay , for rate 2 codes is given in Fig. 1. The con- 
straint length of the code is N = [(b — 1)é-+ 1]n where ? 2 1 isa block 
interleaving constant. 

Although encoding is specified by the A matrix, it is useful to interpret 
encoding as the interleaved encoding of £ subcodes in the following way. 
Blocks 0, £, 2¢, 3¢, --- form the first subcode. The k-tuple of information 
bits, I;., of the [zé]th block (¢ = 0, 1, 2, ---) is encoded into an n-tuple 
M ;, which is the concatenation of I;, and a parity (n — k)-tuple Q;,: 


Mi, = Tye || Qie - (1) 
I;, can be represented as the concatenation of (b — 1) equal length 
segments: 
Lee = Fell Zell +: Wa. (2) 
The parity (n — k)-tuple Q,, is 
Qi = Pit Tii-1¢ se (say ¢ ae ap | i parvety (3) 


where P;, is the parity (n — k)-tuple obtained by encoding J;, with 
the block code parity check matrix H. Thus each encoded subcode block 
is a block code word whose parity portion is modified by the addition 
of an information segment from each of the previous (6 — 1) subcode 
blocks. Further the jth information segment of the [z¢]th block is added 


to the information portion of the [(2 + 7)é]th block = 1, 2,---,b— 1). 
MUMECR:. 206. fs ge toeGc eee, ac ASP Gree et She. TB 





Fig. 1—Ay matrix of a rate 2/3 code. 
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A given block of a subcode is decoded by the burst-trapping procedure 
in one of three ways. Successive blocks of a subcode (blocks 0, ¢, 2¢, - ++) 
are decoded by Random Error Decoding (RED) as long as the decoder 
decides that ¢ or fewer errors occur in each block. When the decoder 
decides that more than ¢ errors occur in a block, for example block 
[2é], then that block is decoded by Burst-Trapping Decoding (BTD). 
The next (6 — 1) subcode blocks {blocks [(¢ + 1)4], [( + 2)4], --- , 
[(¢ + b — 1)f]} are decoded by Blind Faith Decoding (BED). Detailed 
descriptions of RED, BTD, and BFD are given below. Successive sub- 
code blocks {blocks [(¢ + 6) 4], [((¢ + b + 1)4], ---} are decoded by RED 
until the decoder again decides that a block has more than ¢ errors. 

Let M%, IX, Q% be the received n-tuple at the [z¢]th block, the 
received information k-tuple portion, and the received parity (n — k)- 
tuple portion respectively. Let P* be the parity (n — k)-tuple obtained 
by encoding J* with the block code parity check matrix H. Let I;, be 
the decoded information k-tuple of the [7é]th block regardless of how the 
decoding is accomplished. 

The primary method of decoding is RED. RED is attempted at the 
[2¢]th block if none of blocks [(¢ — b + 1)é], [@ — b + 2)4], --- ,[G@ — 
1)£] are decoded by BTD. RED is the removal of the effects of previous 
block information segments from the parity portion and the decoding 
of the block by bounded distance decoding of ¢ or fewer errors. That is, to 
decode the [zf]th block the decoder computes 


te = OF, c Tia “fs Raye ar ie + are (4) 


and decodes I; || P/, as a block code word. Following standard terminol- 
ogy for recurrent codes we will say that I',_.,,, Py-sy2, 00 y PR eavye 
are “fed back” to the [7¢]th block. 

The secondary method of decoding is BTD. BTD is effected when a 
RED attempt indicates that the block code word is detected in error 
but cannot be corrected by bounded distance decoding. If this occurs 
in block [72] then blocks [(¢ + 1)4], [@ + 2)4], --- ,[@ + 6 — 1)4] are 
necessarily decoded by BFD (to be described subsequently) and decod- 
ing of block [if] is delayed until block [(¢ + 6 — 1)£] has been decoded. 
The information segments of block [7¢] are obtained from the corre- 
sponding parity portion of blocks [(¢ + 1)4], [(@ + 2)é], --- , [@ + 
b — 1)4] as follows 


71 72 73 Fbo-1 : 
it OF aie + Pare a Loi-aye + Li-2)¢ + wee + L G—-b+2)¢ » (5) 
72 1 73 Fb-1 . 
fy a Qhi+2)¢ + PEis2ye = Liiaaye = Way + a aa =f L543) ¢ , (6) 
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ii = Qéi+3)¢ “a Pés3y6 ote Liaw ae Lape - ae 
; i ie cia fe irene ; (7) 


JTb- T F2 yb-2 
Let =Qhav-pet Pas-1ye iz Ltsae—2ye —- i45-3)0 oe es =f Losiye . (8) 


In equation (6), for example, we will say that (Q¥,,.), + P*:..),) and 
P.4,), are “fed forward” and J?,_,,,, +++ , [eftsa), are “fed back” 
to the [7¢]th block. 

The third method of decoding is BFD. BFD is effected at the [zé]th 
block if one of blocks [(2 — b + 1)é], [@ — b + 2)4], --- , [(@ — 1)€] has 
been decoded by BTD. BFD of [zf]th block is the use of the received 
information k-tuple as the decoded information k-tuple. That is 


I;, = 1%. (9) 


III. COMMUNICATION CHANNEL 


We consider channels where each block word (binary n-tuple) is 
subjected to the component-wise modulo-two addition of an error 
pattern (binary n-tuple) during transmission. We define a partition of 
the set of 2” possible error patterns as follows. 


C,—is the set of one element—the pattern with no errors. 

C.,—is the set of channel error patterns which are identical to nonzero 
code words. 

C.,— is the set of nonzero channel error patterns which are correctable 
by RED (bounded distance decoding of ¢ or fewer errors). 

C,,—is the set of channel error patterns which are both uncorrectable 
by RED and undetectable (but are not nonzero code words). 

C—is the set of channel error patterns which are detectable (but not 
correctable by RED). 


We consider channels where error patterns separated by ¢ or more 
blocks occur independently. On burst or compound channels, proper 
design of the burst-trapping procedure requires sufficient block inter- 
leaving that the requirement of independent error patterns is approxi- 
mately met. The nth power* of the binary symmetric channel with 
any £ = 1 is included in the class of channels under consideration. 

Let Po, De,» Pe» Puy Pa be the probability that the channel error 
pattern for a particular block is in set Cy, C., , C. , C.., Ca respectively. 
Let a be the probability that the information bits of a received word are 
unaffected by the channel error pattern given that the channel error 
pattern is either correctable, detectable, or undetectable. For the class 
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of communication channels under consideration the probability that 
the error patterns in successive blocks of a subcode are in sets C; and 
C; is Did; » 1, je{0, W, C, U, d}. 


IV. ANALYSIS OF PERFORMANCE 


Since each subcode is independently and identically decoded it suffices 
to analyze the decoding of one subcode. The decoding of successive 
blocks of a subcode can be described by a set of states and a set of 
transition probabilities between states which form a Markov Chain. 
The set of states is partitioned into a set of ‘‘normal” states and a set of 
“anomalous” states. Given the block code parameters, the sequence of 
states is determined by the error pattern sequence. The block code 
parameters which are required are d,,, the minimum distance of the 
block code, and ¢, the amount of bounded distance random-error-cor- 
rection done in RED. 

Before enumerating the states we give a general description of the 
two sets of states. In all following discussion we assume the decoding 
of a single subcode. A block is decoded in a normal state only if all the 
blocks containing information segments fed back to that block are 
correctly decoded. Thus a block decoded in a normal state can only 
be in error due to its own error pattern or due to errors which are fed 
forward. A block is decoded in an anomalous state if one or more of 
the blocks containing information segments to be fed back to that 
block are incorrectly decoded. Once a block is decoded in an anomalous 
state the decoder is affected by fed back errors in addition to the channel 
error pattern sequence. Successive blocks are assumed to be decoded 
in anomalous states until a run of V blocks with no channel errors 
occurs. V is termed the recovery space for a subcode. V is determined 
in terms of d,,.and t Gndependent of details of the specific code) so 
that if no channel errors occur in a period exceeding (V — 1) blocks, 
then no errors are fed back to subsequent blocks regardless of the 
previous channel history. The first block after a run of V blocks free 
of channel errors is decoded in a normal state. A block decoded in an 
anomalous state can be in error due to its own error pattern, due to 
errors which are fed forward, and/or errors which are fed back. Error 
propagation which is due to fed back errors is bounded and can occur 
only in anomalous states. 

Each normal state is numbered by means of the following notation: 


The first digit represents the method of decoding 
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1—Random Error Decoding (RED), 
2—Burst-Trapping Decoding (BTD), 
3, 4, °°: , (b + 1)—Blind Faith Decoding (BFD). 


States whose first digit is 1 or 2 have a two digit number. States whose 
first digit is 7,3 S$ 7 S (0 + 1), have aj digit number. The last digit 
is O(1) to designate that the block is correctly (incorrectly) decoded. 
Interior digits for blocks with 8 < 7 S (b + 1) digit numbers designate 
the decoding history of the (j — 2) previous blocks. An interior digit is 
0(1) to designate that its corresponding block is correctly (incorrectly) 
decoded. For rate (b — 1)/b codes there are 2”** normal states. Normal 
state diagrams illustrating this notation are given in Figs. 2 and 3 
for rate 3 and 3 codes respectively. Throughout this paper a rate 3 code 
will be used in a running example. The analysis technique is easily used 
for any rate (6 — 1)/b code. 

Since the error pattern sequence determines the state sequence the 
transition probabilities between normal states can be expressed in terms 
Of Po, Dw, Pe» Duy Pa and a. Transition probabilities between normal 
states are given in Figs. 2 and 3 and Appendix A for rate } and 3 codes. 
For simplicity of notation in writing the one step transition probabilities, 
P:i,;, from state 7 to state 7 the normal states are renumbered as in 
Figs. 2 and 3. 

The normal state diagrams represent the possible state transitions 
until an undetected error occurs (state 11) or a BTD and its associated 
(b — 1) BFD’s occur [states (b + 1)00 --- Oto (6 + 1)11 --- 1]. Transi- 
tions from state (b + 1)00 --- 0 or state (6 + 1)10 --- 0 (states marked 
with ¢@ in Figs. 2 and 3) are the same as those from state 10 since the 


' + 
(Po +P) ( Kv) (Put Pw) 


Pd (Pot Pw) 






Fig. 2—Normal state diagram for rate 1/2 codes. 
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Fig. 3—Normal state diagram for rate 2/3 codes. 


last (6 — 1) blocks containing information block segments to be fed 
back are correctly decoded. Transitions from other normal states 
(marked with X in Figs. 2 and 3) are to anomalous states since one or 
more of the last (b — 1) blocks containing information block segments 
to be fed back are incorrectly decoded. The enumeration of the anom- 
alous states is presented later. 


Vv. AN OPTIMISTIC ESTIMATE OF THE PROBABILITY OF BLOCK ERROR 


If we assume, for purposes of obtaining an optimistic estimate of 
performance, the presence of a Genie Decoder which corrects all fed 
back information, then transitions from normal states marked X (in 
Figs. 2 and 3) are the same as those from state 10 or the two states 
marked ¢. Note that with the Genie Decoder blocks can still be in- 
correctly decoded and incorrect information can be fed forward but 
only correct information can be fed back. The assumption of a Genie 
Decoder in effect eliminates error propagation (which arises from 
erroneous feedback) and the only possible states are normal states. 
The entire transition probability matrix [p;,;] is then known from the 
normal state diagram (for example, Figs. 2 and 3) where p,;,,; is the one 
step transition probability from renumbered state z to renumbered 
state 7. The Markov Chain is regular and therefore the stationary 
probabilities exist.” The stationary probability +; of being in renumbered 
state 7,7 = 1, 2,--- , 2’*', can be obtained from 


Qo +2 


m= > TsDi i (10) 


7=1 
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and 


gb +1 


bbe nee (11) 
i=l 
The probability of block error with a Genie Decoder, P,,, is the 
probability of being in a normal state whose identifying number has a 
last digit of 1. For rate 2 codes, 


P., = ts + we + 3 + to + M10 + Ms + Tia + Te. (12) 


Expressions for P,, for rate 4 and 3 codes are given in Table I. For 
higher rate codes numerical determination of the stationary probabilities 
which yield P,, seems preferable to determination of an expression 
for P,,. 


5.1 Upper Bound on the Probability of Block Error 


An upper bound on the probability of block error can be obtained by 
considering worst case error propagation. The set of anomalous states 
is used to represent the decoder when error propagation can occur. 
Assume that one or more of blocks [(¢ — b + 2)¢] to [7¢] is incorrectly 
decoded and that block [if] has channel errors but all succeeding blocks 
[(@ + 1)¢], [¢ + 2)¢], --- have no channel errors. Error propagation 
is the effect that, although no channel errors occur beyond block [7é], 
decoding errors in block [i¢] and/or previous blocks may, through feed- 
back, cause decoding errors to occur in some succeeding blocks [(¢ + 1)¢], 

The amount of crror propagation, a, is the number of blocks after 
the last block with channel errors that have decoding errors. The length 
of error propagation, \, is the number of blocks after the last block 
with channel errors up to and including the last block with decoding 
errors. Upper bounds A and A on a and X respectively are derived in 
Appendix B and given in Table II for codes with d,, 2 2¢ + 2. In Table 
II the notation |_¢ | means the greatest integer less than or equal toz. 

Another required quantity, the recovery space, is the minimum 
number of blocks after the last block with channel errors that must 
be free of channel errors to guarantee that error propagation ceases 
and to guarantee that the decoder has completed any BTD decoding 
and associated BFD decodings resulting from error propagation. 
Specifically, the recovery space, V, is defined as the minimum number 
of consecutive blocks free of channel errors (blocks [(@ + 1)4], 
[(¢ + 2)é], --- , [@ + V)é] required to guarantee that the decoder will 
return to one of normal states {10, 11, 20, 21} at block [(@ + V + 1)J] 
regardless of the channel error sequence prior to block [(¢ + 1)l]. The 
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TaBLE JI—REcovERy SPACE AND BOUNDS ON THE AMOUNT AND 
LENGTH OF ERROR PROPAGATION FOR CoDES WITH d,, > 2¢ + 2 
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recovery space for codes with d,, = 2¢ + 2 is derived in Appendix B 
and is given in Table II. Values for A, A, and V are presented in Table 
III for typical values of b, ¢, and d,, . 

The decoder can be represented by (V + 1) anomalous states, as in 
Fig. 4, when it is not in a normal state. State A, exists whenever channel 
errors occur in a block. States A,, A, --- , Ay represent successive 
blocks free of channel errors. In Fig. 4 state X represents any normal 
state marked X in Figs. 2 and 3 from which the transition from normal 
state to anomalous state occurs. A complete state diagram includes 
both normal and anomalous states. The transition probability matrix 
is implicitly given in Figs. 2(3) and 4 for rate 3(3) codes. The Markov 
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Chain is regular and therefore the stationary probabilities exist.’ Let 
p1,7=1,2,--- ,2°*', Ay, Ar, --: , Ay be the stationary probabilities 
of being in the respective states. 

An upper bound on the probability of block error, P..; , is obtained 
by summing the stationary probabilities that the decoder is in a normal 
state whose last digit is 1 or in an anomalous state A, through Ay-_,. 
If the decoder reaches state Ay then correct decodings are assured in 
states Ax, to Ay, but if the decoder returns to state A» after state 
Aasi,j = 1,2, °°: , WV — A — 1) correct decodings are not assured 
in states Ay,, to Ay,;. A tighter bound which accounts for this dif- 
ference will be obtained next. For rate 3 codes with t = 1 and d,, = 4 


Poss = ps + poe + ps + po + pro + pis + pis + pis + Paw 
+pa, + Pa, i PAs ss PAg- (13) 


Expressions for P,,, for rate $ and 2 codes are given in Table I. 

A tighter upper bound, P..2., is obtained by using 2V anomalous 
states as in Fig. 5. State By exists whenever channel errors occur. 
States B,, B,, --- , By-1 represent successive blocks free of channel 
errors when the total number of consecutive blocks free of channel 
errors is less than V. States C, , C., --+ , Cy represent successive blocks 
free of channel errors when the total number of consecutive blocks 


Tasue ITI—A, A, V For Typican VALUES or CopE PARAMETERS 





CopE PARAMETERS A A V 
b= 2, dn > 2t +2 1 1 2 
b=3, t=1, dn >4 2 2 5 

t=2, dn >6 3 3 5 
t=4, dn = 10 4 4 6 
dm > 11 3 3 5 
b=4, t=1, dn >4 4 4 9 
t=2, dn =6 5 6 9 
dn > 7 4 6 9 

t = 3, dm =8 6 7 10 
dm = 9 5 6 9 

dm = 10 5 6 9 

dm > 11 4 6 9 
t= 4, dm = 10 7 8 11 
dm = 11 6 7 10 

dm = 12 5 6 9 

dm = 18 5 6 9 

dm = 14 5 6 9 

dn > 15 4 6 9 
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Fig. 4—(V + 1) anomalous states for P... bound on probability of block error. 


et 





Fig. 5—(2V) anomalous states for Pye bound on probability of block error. 
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free of channel errors is at least V. In Fig. 5 state X represents any 
normal state marked X in Figs. 2 and 3 from which the transition 
from normal state to anomalous state occurs. A complete state diagram 
includes both normal and anomalous states. The transition probability 
matrix is implicitly given in Figs. 2(3) and 5 for rate $(2) codes. The 
Markov Chain is regular and therefore the stationary probabilities 
exist.” Let s;,7 = 1,2, ---,2°*', Bo, Bi, +++, By-1,01,C2,°°', Cy 
be the stationary probabilities of being in the respective states. 

P42 is obtained by summing the stationary probabilities that the 
decoder is in a normal state whose last digit is 1 or in an anomalous 
state By through By_, or C, through C4. For rate 3 codes with t = 1 
and d,, 2 4 


Pous = Ss + 86 + 83 + So + Siro + S13 + Sia + Sis + Sp, 
+ 8p, + 82, + 83, + 85, + 8c, + Se,- (14) 


Expressions for P,.2 for rate + and 2 codes are given in Table I. 
2 3 pea 


5.2 Lower Bound on the Probability of Block Error 


A lower bound on the probability of block error, P,.,, is obtained 
by summing the stationary probabilities that the decoder is in a normal 
state whose last digit is 1. That is, it is assumed that no decoding 
errors are made when the decoder is in anomalous states. For rate 


% codes with ¢ = landd,, 2 4 
Pir = ps + ps + Ps + Po + pro + pis + pis + Pics - (15) 


Expressions for P,;, are given in Table I. 


VI. PERFORMANCE OF TWO CODES 


The performance of a rate } (18, 9) code of minimum distance d, = 6 
has been evaluated on the binary symmetric channel (¢ = 1). This 
code is obtained by extending the (17, 9) quadratic residue code of 
minimum distance d,, = 5 by one bit. Upper and lower bounds on 
the probability of block error for the (18, 9) code used in burst-trapping 
with ¢ = 1 and t = 2 versus the binary symmetric channel transition 
probability, p, are given in Fig. 6. The probability of block error for 
maximum likelihood decoding of the (18, 9) code and the probability 
of block error for an uncoded 9 bit block are presented for comparison. 
It is interesting to note that the performance of the code is better 
with burst-trapping decoding (¢ = 2) than with maximum likelihood 
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BINARY SYMMETRIC CHANNEL 
ro) 
i} 
oy 


TRANSITION PROBABILITY 


S 
uw 





10-6 
10724 10720 10716 {o7!e i078 1074 10° 
BLOCK ERROR RATE 


Fig. 6—Performance of (18, 9) code on binary symmetric channel. a. Upper and 
lower bounds for burst-trapping procedure, ¢ = 2; b. Upper bound for burst-trapping 
procedure, ¢ = 1; c. Maximum likelihood eae: d. Uncoded 9-bit block; e. Deci- 
sion feedback, ¢ = 0; f. Decision feedback, ¢ = 


decoding for values of p where the rate } is much less than the channe 
capacity. Channel capacity is $ when p = 0.11. The probability of 
block error for two decision feedback systems using the (18, 9) code 
are also presented for comparison. In one system, (¢ = 0), repeat 
requests are made on all received n-tuples but code words. In the 
other system, (¢ = 2), single and double error corrections are made 
and repeat requests are made on all received n-tuples but code words 
or code words perturbed by one or two errors. 

The performance of a rate 3 (39, 26) shortened BCH code of minimum 
distance d,, = 6 with t = 1 has been computed on the basis of recorded 
telephone error data. One set of recorded telephone error data is the 
Vestigial-Sideband (VSB) data.°” A selected set of 85 calls was used. 
Each call is an error sequence of about 3 X 10° bits recorded at 3600 b/s 
(4-level operation of the VSB modem). The 85 calls were divided into 
groups of calls of similar bit error rate as shown in Table IV and P(m, 39) 
statistics’ were determined for each group. P(m, 39), m = 1, 2, --- , 39, 
is the probability that m errors occur in a block of 39 bits. Estimates 
Of Po, De» Dw, Pa} Du, and a were obtained for each group by using 
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approximate code and coset weight spectra. A plot of the distribution 
of the percent of calls (quantized by the grouping of calls) with respect 
to raw (39 bit) block error rate and the upper and lower bounds on the 
distribution with respect to decoded block error rate is given in Fig. 7. 
The distribution of the percent of calls with respect to decoded block 
error rate as estimated by computer simulation” on the same 85 call 
sample is also given for comparison. For the comparison simulation a 
block interleaving degree £ = 117 was used as this amount of inter- 
leaving attained approximate independence between successive blocks 
of the subcodes. 

Another set of recorded telephone error data is the Alexander-Gryb- 
Nast (AGN) data.° AGN data consists of about 1000 calls recorded 
at data rates of 600 b/s and 1200 b/s on an FM data modem. These 
calls are from three classes of calls of approximately 3.6 X 10°, 7.2 X 10°, 
or 2.16 X 10° bits in length. The 294 calls with bit error rate greater 
than 107° were divided into groups as shown in Table V and estimates 
of Po, Dec; Dw» Pay Pu, aNd a were obtained as for the VSB data. A 
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Fig. 7—Distribution of 85 call VSB sample with respect to block error rate. a. 
Uncoded 39 bit blocks; b. Simulation of (89, 26) code interleaved to degree 117; 
c. Upper and lower bounds for (39, 26) code. 
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plot of the distribution of the percent of calls (quantized by the group- 
ing of calls) with respect to raw (39 bit) block error rate and the upper 
and lower bounds on the distribution with respect to decoded block 
error rate is given in [igs. 8 and 9. The performance as estimated by 
computer simulation” on the same call sample is also presented for 
comparison. 

For both sets of data there is good agreement between the performance 
estimates obtained by the theory and simulation. Two advantages of 
the theoretical technique over the simulation technique are the ability 
to obtain the tail of the distribution and the ability to obtain the 
distribution from reduced data. This latter advantage is due to the 
fact that po, Pe, Pw, Pa, Pu, and a can be approximately determined 
from reduced data such as P(m, n) statistics. 


VII. CONCLUSIONS 


A technique for analyzing the performance of a burst-trapping error 
correction procedure has been described. The criterion of performance 
is the probability of block error. The analysis technique for burst- 
trapping procedures with block interleaving degree ¢ is valid on channels 
where error patterns in blocks separated by £ blocks are (approximately) 
independent. Thus the analysis technique is valid for random error 
channels or for properly designed burst-trapping procedures on burst 
or compound channels such as the telephone channel. 

The performance of a rate 2 code, the (89, 26) shortened BCH code, 
has been computed for two sets of recorded error data. For both sets 
of data the computed performance agrees with the performance obtained 
by computer simulation. An advantage of the theoretical technique over 
simulation is the ability to estimate performance on the basis of reduced 
data [P(m, n) statistics] rather than on extensive error sequence data. 
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APPENDIX A 


Transition Probabilities for Normal State Diagrams 


For simplicity the development of the one step transition probabilities 
;,; from renumbered state 2 to renumbered state 7 is demonstrated for 
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Fig. 8—Distribution of AGN call sample with respect to block error rate. a. 
Uncoded 39 bit blocks; 2. Simulation of (39, 26) code interleaved to degree 117; 
c. Upper and lower bounds for (89, 26) code. 


rate 2 codes (Fig. 3). The technique is easily generalized to rate (b—1)/b 
codes, b = 2. Obviously, 


Pia = Do + De ; (16) 
Pi.9 aa Du + Pw ; (17) 
Pier Piao: Par (18) 


Let p;,;(b) be the b step transition probability from renumbered state 
z to renumbered state j. Due to the structure of the normal state diagram 
it is easily seen that, 


Pie = Pr,4(3) + P1,5(8) + pi,7(8) + D1,8(8); (19) 
P23 = (1 — pois) = SS } (20) 
P34 > (1 — ps3.5) = Prs8) ) (21) 


? 
P1.2Pe2.3 
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Fig. 9—Distribution of AGN call sample with respect to block error rate. a. 
Uncoded 39 bit block; b. Upper and lower bounds for (39, 26) code. 


Pi 73) & (22) 


= 1 — = 
Ps.7 ( Ds.8) D1.0Ds.6 


The three step transition probabilities p:,4(3), p1,5(3), P1,7(3), DP1,8(8) 
can be computed by summing the probabilities of all combinations of 
three successive error patterns which cause transition from normal 
state 10 to normal states 4000, 4001, 4010, and 4011 respectively. 


Pi,s(8) = Dao 5 (23) 
D1,s(3) = PaPoDw } (24) 
P1,7(3) = PaPuPo 5 (25) 
Pi,s(8) = Pape - (26) 


Further, 


Piji0 = P1,12(8) D1 ,13(8) “te Pi ,15(8) ar P1,16(8) ; (27) 
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Ps.12(8) + r,13(8) , (28) 


Pio = ¢! _ Pro,14) = Dr.10 


Pi a 12(3) . (29) 


=e = 
Pir,12 ( Prs.3s) P1,10P10,11 


P1,13(3) : (30) 


=(1— = 
Pi4,15 ( Prs.10) P1,10P10,14 


The three step transition probabilities p,,12(8), 71.13(8), P1,15(8), P1,16(3) 
can be computed by summing the probabilities of all combinations 
of three successive error patterns which cause transition from normal 
state 10 to normal states 4100, 4101, 4110, 4111 respectively. 


Pi12(8) = palo”(p. + pu + pa)’ + 2poa(p. + pu + pad}; (31) 
Piis(3) = pafa(l — a)(p. + pu + pa)” + poll — @)(p. + pu + Da) 

+ ape + Pu + Pa)Pu} (32) 

Piss(8) = Pijs(8); (33) 

Pirs(3) = pal(L — @)’(p. + pu + pa)” + 2p.(1 — @)(p. + Pu + pa)}- 

(34) 


The transition probabilities for rate $ codes are given in Fig. 2. The 
transition probabilities for rate 3 codes with the exception of 


a'(pe + pu + pa) + 2op 








Puae = epee (35) 
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ne a)" (p. ae ‘bo AE Oe. (38) 


are given in Fig. 3. 


APPENDIX B 


Bounds on the Amount and Length of Error Propagation and Determina- 
tion of the Recovery Space 
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We consider codes in which d, = 2¢ + 2. Let 0 S e; S k be the 
maximum number of errors possible in the information part of the 
decoded word at block [7]. The value of e; depends on the method 
of decoding the block and the error pattern sequence. We will say that 


f= » e; (39) 
F=i-b+2 

is the maximum number of errors ‘‘available”’ for feedback to blocks 
after block [i]. As in the text, assume that one or more of blocks [(¢ — 
b + 2)é] to [zé] is incorrectly decoded and that block [i¢] has channel 
errors, but all succeeding blocks [( + 1)¢], [@ + 2)é], --- , have no 
channel errors. We consider three mutually exclusive and exhaustive 
cases. We use the fact that a block code of minimum distance d,, is 
simultaneously capable of correcting ¢ errors and detecting d = ft 
errors ifd, =t+d+1. 


B.1 Case 1 
Assume that no error detections (BTD’s) occur in blocks [(@ + 1)4], 
[(@ + 2)£], --- . Under this hypothesis error propagation cannot occur 


beyond block [7¢] if f; < d,, — ¢. The maximum length of error propaga- 
tion is then the smallest integer A, such that fis,, < d, — t. Since 
f; = ® — Dk, blocks [@ + 1)€] to [(@ + 6b — 1)£] are subject to decoding 
error due to error propagation and therefore f;,,-. = (0 — 1)t. Each 
subsequent block, [(¢ + 6)4], [(@ + 6 + 1)£], --- , which is correctly 
(incorrectly) decoded removes ¢ (d,, — 2¢) errors from the maximum 
number available for feedback. Therefore 


o— y +|G= 2), if dx —2t<t 
A, = ? (40) 
(— 1) + | Ma Pda = 20 | if d, —2t>t 


where [_z_| is the greatest integer less than or equal to z. 
The maximum amount of error propagation is 
= ee (b — | 
4,=@-+|S=3 (41) 


Blocks [(¢ + A, + 6)4], [(¢ + A, + 6 + 1)4], --- are correctly decoded 
by RED in normal state 10. 


B.2 Case 2 


Assume that an error detection (BTD) occurs in block [(@¢ + 4)4], 
1 <j S 6b — 1. Under this hypothesis error propagation cannot occur 
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beyond block [(@@ + 7)4]. The maximum length of error propagation is 


As =b—-— 1 (42) 

and the maximum amount of error propagation is 
A,=b-—1. (43) 
Blocks [(@@ + A. + 6)4], [7 + Az + b + 1)é], --- , are correctly de- 


coded by RED in normal state 10. 


B.3 Case 3 


Assume that an error detection (BTD) occurs in block [(¢ + 4)4], 
b <j S J, where J is the maximum value of j such that block [(¢ + 7) ¢] 
can be detected in error when the last channel errors occur in block 
[2f] and blocks [(¢ + 1)¢], [(¢ + 2)¢], --- are free of channel errors. 
Under this hypothesis, error propagation cannot occur beyond block 
[( + 9)€]. For block [(¢ + J)é] to be detected in error it must have 
t; 2 t + 1 errors fed back to it. For b = 2 (rate 4 codes) J = b — 1, 
and Case 3 cannot occur. 

As in Case 1, f; = (0 — 1)k, and blocks [(¢ + 1)4] to [(¢@ + 6b — 1)4] 
are subject to decoding error due to error propagation. Therefore, 
fiso-1 = (6 — 1)t. Each subsequent block, [(¢ + b)4],[((@ +b +1)4, ---, 
which is correctly (incorrectly) decoded removes é(d,, — 2é) errors from 
the maximum number available for feedback. Let H, be the largest 
integer such that f;,7, 2 ¢ + 1. Then when b 2 3 


o- y+ [Oa Be) | if’ d, = Bt 


2b — 4 i! Dy = QE Sts 


IIA 


b; 
H, = (44) 


Since errors must be fedback to block [(¢ + J)4] from at least two 
blocks to get t, > t feedback errors, 


J =H,+ (6 — 2). (45) 
B.3.1 Case 3a 
Assume block [(¢ + 7)¢] is correctly decoded by BTD. Then 
As = H, : (46) 


A, (b-—1)+ O22). (47) 


d= Ot 


I 


Blocks [(@ + J + b)€], [(@ + J + b+ 1)¢], --- are correctly decoded in 
normal state 10, 
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B.3.2 Case 3b 


Assume block [(¢ + j)4] is incorrectly decoded by BTD. Now b S 
j3 = GS J, where Gis the maximum value of j such that block [(¢ + 7)4] 
can be detected in error and incorrectly decoded due to error propaga- 
tion when the last channel errors occur at block [7¢] and blocks [(7 + 1)4], 
[(@ + 2)é], --- are free of channel errors. For block [(¢ + G)¢] to be 
detected in error it must have t; = ¢ + 1 errors fed back to it to cause 
the detection and f, = 1 errors fed back during the BTD to cause er- 
roneous decoding. 

If fiss1 = (6 — 1lDt < t+ 2, G = b — 1 and Case 3b cannot occur. 
Let H, be the largest integer such that f;.7, > ¢ + 1. Then when 
b = 8and (6 — 2)t = 2 


Jo-n+ [So I, ae eae 
Jo- 9+ |S=2=2), if -d@, S28 S 4 


Since errors must be fed back to block [(¢ + G)4] from at least two 
blocks (three blocks if t = 1) to get ¢; + # 2 ¢ + 2 feedback errors 


(48) 


IV 


23 


H,+(b-— 83), if t=1. 
— 2)t— ieee 
Ay pe iy b= ee). (50) 


Blocks [(¢ + A, + b)é], [(( + A, + 6b + 1)4], --+ are correctly decoded 
in normal state 10. 
Table I is constructed by taking 


A = max {A,, Ac, As, Aa} (51) 
and 
A = max {A,, 42, As, Aa}. 


By definition the recovery space is the minimum number of con- 
secutive blocks free of channel errors required to guarantee the return 
of the decoder to one of normal states {10, 11, 20, 21} at block [(@ + 
V-+1)¢] regardless of the channel error sequence prior to block [(¢-++1)4]. 
We say that V is a necessary recovery space if fewer than V consecutive 
blocks free of channel errors do not guarantee transition to one of 
normal states {10, 11, 20, 21} at block [@ + V + 1)4]. We say that 
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V is a sufficient recovery space if V consecutive blocks free of channel 
errors guarantee transition to one of normal states {10, 11, 20, 21} 
at block [(@@ + V + 1)é]. For Cases 1, 2, and 4V; = A, + ( — 1), 
2 = 1, 2, and 4, is a necessary and sufficient recovery space. For Case 3 
V; = As + (2b — 8) is a necessary and sufficient recovery space. Since 
in all cases V 2 V;,2 = 1, 2, 3, 4, is a sufficient recovery space V = 
max {V,, Ve, V3, Va} is a necessary and sufficient recovery space. 


APPENDIX C 


List of Symbols 


—hblock interleaving constant 

—parameter determining rate of recurrent code 

-—recurrent code parity check matrix 

—component block code parity check matrix 

—constraint length of recurrent code 

—recurrent code truncated parity check matrix 

—block length of component block code 

—number of information bits per block of component block code 

—k-tuple of information bits of [zé]th block 

—n-tuple of transmitted bits of [z¢]th block 

—(n — k)-tuple of parity bits of [zé]th block 

—jth segment of I;, 

—n-tuple of received bits of [7f]th block 

—k-tuple of received information bits of [z¢]th block 

—(n — k)-tuple of received parity bits of [7¢]th block 

—parity (n — k)-tuple obtained by encoding J* with H 

—k-tuple of decoded information bits of [z¢]th block 

—Q* as modified by fed back information segments 

—jth segment of I;, 

—the set of one element—the pattern with no errors 

—the set of channel error patterns which are identical to nonzero 
code words 

—the set of nonzero channel error patterns which are correctable 
by RED 

—the set of channel error patterns which are both uncorrectable 
by RED and undetectable 

—the set of channel error patterns which are detectable 

—the probability that the information bits of a received word 
are unaffected by the channel error pattern given that the 
channel error pattern is correctable, detectable, or undetectable 
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Do —the probability that the channel error pattern is in set Cy 

Dw —the probability that the channel error pattern is in set C,, 

De —the probability that the channel error pattern is in set C, 

Di —the probability that the channel error pattern is in set C, 

Da —the probability that the channel error pattern is in set Cz 

d, minimum distance of the component block code 

t —amount of error correction done in RED 

V —recovery space 

P:.; single step transition probability from state 7 to state 7 

T; —stationary probability of being in state 2 with Genie Decoder 

P,., —probability of block error with Genie Decoder 

a —amount of error propagation 

A —upper bound on a 

d —length of error propagation 

A —upper bound on \ 

A; —designation of anomalous states for upper bound one on block 
error probability 

pi —stationary probability of being in state 2 for upper bound one 

P 4, —upper bound one on probability of block error 


B, ,C; —designation of anomalous states for upper bound two on block 


§; 


error probability 
—stationary probability of being in state 7 for upper bound two 


P42 upper bound two on probability of block error 
P., —lower bound on probability of block error 
p;,;(3)—three step transition probability from state z to state 7 


6; 


fi 


d 


—maximum number of errors possible in decoded information 
k-tuple at block [7¢] 

—maximum number of errors available for feedback to blocks 
after block [7¢] 

—amount of error detection capability of component block code 
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Synthesis of Stochastic Representations ot 
Ground Motions 


By S. Cc. LIU 
(Manuscript received December 4, 1969) 


In this paper, we study a number of stochastic models including station- 
ary, nonstationary, and linear processes for the purpose of simulating 
earthquake- or explosion-induced ground motions. The important sta- 
tistical characteristics of each model and their effects on structural systems 
are investigated in some detail. We obtain expressions for the mean-square 
response of simple linear mass-spring oscillators to each model. We discuss 
numerical procedures for time series simulations of these models. The 
objectives of this paper are (i) to examine and compare the statistical 
properties and effects on structures of all possible stochastic processes 
applicable to model ground motions and (iz) to offer engineers a basis for 
forming their own judgments. 


I. INTRODUCTION 


A primary concern in problems dealing with earthquake or blast 
response is the proper definition of random force environments. Typical 
problems include the design of earthquake-resistant frames for electronic 
or mechanical facilities in a building, and the estimation of structural 
damage resulting from nuclear detonation in a given area. Normally 
it is necessary to create ground-motion data artificially from information 
derived from limited recordings. Therefore, in ground-motion analysis, 
as in many other fields of engineering physics, time series modeling or 
simulation problems emerge. This paper carries forward the concern 
with such problems. 

In a previous paper the statistical characteristics of a collection of 
earthquake ground-motion data were analyzed.’ It was shown that a 
stationary random process of finite duration could be used to model 
the high-intensity phase of a ground-motion accelerogram. It was sug- 
gested that a narrowband stationary process be used. However, the 
narrowband process, like many other stationary models, fails to produce 
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the initial buildup and the decaying terminations which are apparent in 
many real ground-motion accelerograms. To simulate these portions, 
nonstationary models must be used. In this paper we investigate a 
number of physically realizable stationary, nonstationary, and linear 
stochastic models, when applicable to the simulation of ground motions. 
We derive the important statistics of these models and discuss numerical 
simulation procedures. The covariance, autocorrelation function, and 
power spectral density of the response process of a class of linear time- 
invariant systems excited by the input process represented by each 
model are examined. It is hoped that by comparing these models for 
basic definition, for simulation procedure, and for effects on induced 
structural responses, a practicing engineer will be able to select one that 
will be suitable for the analysis of his specific problem. It is the intent 
of this paper not only to sum up the current state of the art/science but 
also to give to researchers in the field of ground motion study such hints 
and directions for the development of advanced stochastic models as 
mathematical sophistication permits. 


II, STOCHASTIC MODELS 


2.1 Stationary Models 


A typical ground-motion accelerogram from an earthquake or nuclear 
detonation consists of three phases: an initial rapid-buildup phase, a 
high-intensity primary phase, and a gradually decaying tail—all ob- 
viously nonstationary phenomena. However, many researchers still 
prefer to model earthquakes by stationary processes because the low- 
amplitude starting and ending portions of an accelerogram do not sig- 
nificantly affect the structural response as compared with the response 
induced by the primary phase. Therefore it appears legitimate to model 
the primary phase by a stationary process of finite duration. Further- 
more, the stationariness assumption greatly simplifies the response 
evaluations and numerical simulation procedures. This feature is partic- 
ularly important from the practical viewpoint. Three stationary models, 
designated as 2,(¢), v2(é), and 2;(t), along with their autocorrelation 
function and power spectral density are defined in Table I. 

The first model, white noise x,(¢), defined as a stationary random 
signal having gaussian probability amplitude distribution and a con- 
stant spectral density for all frequencies, is the simplest one of all. 
Numerically, it can be simulated by generating a sequence of gaussian 
independent samples of gaussian random numbers g, , spacing them at 
small time interval At, and assuming linear variation between amplitudes 


TABLE I—STATIONARY MODELS AND CORRESPONDING AUTOCORRELATION AND SPECTRAL Density FuNcTIONS 
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over each At. Bycroft? has studied this overly simplified model on an 
analog computer. This model fails to provide any frequency descriptions 
of the motions that are so important to the structural response analysis; 
its use results solely from its mathematical simplicity. 

Tor model 2,(t), the filtered white noise, symbols h,(t) and H,(w) 
in Table I represent the transfer function in the time and frequency 
domains, respectively. The process x.(¢) is a gaussian, covariance sta- 
tionary, narrowband process. The use of 22(¢) in modeling earthquake 
ground motions is based upon the resemblance of the autocorrelation 
function, the power spectral density, and the response spectra of strong 
motion earthquakes to those of the narrowband process.’’*’* The 
numerical simulation of x,(t) based on prescribed power spectral density 
is a routine exercise using the basic relationship between the power 
spectral densities S,,(w) and S,.(w) of the input and output of the linear 
filter: 


S.2(w) = | Ho) |? Si). (1) 


This equation suggests that a signal x.(¢) can be created from the random 
process x,(¢) whose spectral density S,,(w) = 1 by passing z,(t) through 
a filter whose transfer function H,(w) satisfies | H(w) |? = S,2(w). 
A detailed approach to simulating stationary processes with a rational 
spectral density function, which is represented by a quotient of two 
polynomials in w, has been described by Franklin. Methods of estimat- 
ing ground-motion spectral densities are given by Liu and Jhaveri.'* 
A sample function of process x2(t), generated digitally by passing a white 
noise through a linear filter with a natural frequency of 10 rad/s and 
a damping ratio of 5 percent, is shown in Fig. 1 which demonstrates a 
typical appearance of a narrowband process. The justification for using 
this process to model ground motions is that both its power spectral 
density function and its response spectrum resemble and can be made 
to match those of real-world records. It reflects the predominant effects 
of the site on motion and, by using a modal analysis, x.(é) can model 
ground motions which exhibit multiple peaks in their frequency spec- 
trograms.* 

For 2x;(¢) as defined in Table I the random impulses {a,} form a 
stationary discrete parameter process, and {t,} is a stationary point 
process independent of {a,}.°’’ As in the expressions for autocorrelation 
function and power spectral density, 6 is the average number of impulses 
per unit time interval and p,(t) represents the probability density 
function for n consecutive intervals of {t,} within a time duration ¢; 
p(n) and P,,(tw) are defined as 
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p(n) = EanOn+nl (any m) (2) 

P,(ia) = | pat) exp (tet) at (3) 
0 


in which H[ ] denotes ensemble averages. 

Notice that the model 2z3(é) allows correlation p(n) to exist among 
the random amplitudes a, which are assumed to be independent for 
many other stochastic models. The simulation of 23(¢) can be achieved 
by the spectral approach as described by Franklin or by the correlation 
approach based on the matrix factorization procedure as proposed by 
Moore and Anderson.* However, when 7,(¢) is poisson with mean arrival 
rate 8 and Markov correlation p(n) = p'"! and | p| < 1, a sample func- 
tion of x3(£) can be created by simultaneous simulations of independent 
samples of {a,} and {#,}. In this case the probability density function 
of the waiting time 7, = 4; — & is an exponential distribution, that is, 
p(tx) = B exp (—@r,) and therefore a sequence 7, can be generated 
from a sequence of uniformly distributed random numbers w;,: 


n= -ZnQd-w), 05m, <1. (4) 


The correlation p'"! can be introduced into {a,} by using an autoregres- 

sive transformation of a sequence of gaussian random numbers g, with 
zero mean and unit variance: 

2\b 7 

a, = (1 —- a 

n ( p ) nr (5) 


, 


an pAy—1 a Gn 7 


Li 


a i 





0 4 8 l2 16 20 24 28 32 
TIME IN SECONDS 


Fig. 1—Sample function of process 22(t). 
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A digitally simulated sample of 23(¢) with p = 0.5, 6 = 1.0, and 
poisson distribution for p,(r) is shown in Fig. 2(a); its autocorrelation 
function and power spectral density are shown, respectively, in Figs. 
2(b) and (c). The time response of a linear filter having a natural fre- 
quency w = 10.0 rad/s and a damping ratio ¢ = 5 percent to this input 
sample member of z,(¢) is shown in Fig. 3(a). The corresponding auto- 
correlation function and power spectral density cof the sample response 
are shown in Figs. 3(b) and (c), respectively. Notice that Fig. 3(b) 
exhibits a damped oscillatory motion with a frequency w = 10.0 rad/s 
which is the natural frequency of the filter. At this frequency there is a 
peak in the power spectral density as shown in Fig. 3(c) which is similar 
to that of strong-motion earthquakes. Notice also that in comparison 
with 2x;(t), which shows abrupt peaks and dips in the waveform, the 
filtered impulse process more closely resembles a ground-motion ac- 
celerogram. Based on these results, it appears that a filtered impulse 
process may be more appropriate than the impulse process 23(¢) itself 
in modeling earthquake motions. 

When ground motions are represented by stationary processes, it is 
extremely important to properly determine the duration and intensity 
of the processes because the induced response of structures depends 
heavily on these two parameters. To those who are reluctant to neglect 
the nonstationary effect resulting from the starting and tail portions of 
earthquake accelerograms, the stationary models I through III ob- 
viously are not satisfactory. One might therefore consider using the 
following nonstationary models. 


2.2 Nonstationary Models 


Five useful nonstationary models, x,(¢) through s(t), are defined in 
Table IT. 

The model x,(é) is a frequency-modulated nonstationary function. 
For its definition in Table II, b; , a; , and w; are given sets of real positive 
numbers, and w; are independent random variables from uniform dis- 
tribution over 0 and 27. The use of x,(¢) is based on the result that the 
skewed bell shape covariance function of 2,(¢) is similar to and can be 
made to match that of an earthquake. Numerical simulations of 2,(¢) 
present no special difficulty as its sample members can be created di- 
rectly for given sets of b; , a; , and w; according to its definition. It may 
be expected that use of a large number of terms as given by 2,(¢) will 
produce member functions that look much more like real earthquake 
accelerograms.” . 

For the model 2;5(¢), ¢(¢) is a deterministic or envelope function and 
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Fig. 2(a)—Digital realization of sample 2x;(t), the impulse process. 
Fig. 2(b Autocorrelation function of sample 23(t). 
Fig. 2(¢)}—Power spectral density function of sample z;(¢). 
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Fig. 3(a)—Digital realization of sample response of 3(¢). 
Fig. 3(b)—Autocorrelation function of sample response of x3(é). 
Fig. 3(c)—Power spectral density function of sample response of x3(é). 


MODEL 


IV 


VI 


VIl 


VII 


TaBLE II—DEFINITION oF NONSTATIONARY MODELS 


NAME 
Frequency Modulated 
Random Function 
Separable Nonstationary 
Process 
Filtered Separable 
Nonstationary Process 


Shot Noise 


Filtered Shot Noise 


DEFINITION 


xa(t) 


I 


> tb; exp ( —a;t) cos (wot + w;) 
j=1 


z(t) = od) f(t) 


ee / err cr: 


—o 


xt) = u a(tr)6(t — tr) 


X(t) = 2 axholt — tx) 


SNOILOIN GNNOUD DILSVHOOLS 


66S 
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f(é) is a stationary random process with given autocorrelation function 
and power spectral density. The function f(t) may be any one of proc- 
esses 2, (t), x(t), and 23(t). This model in its various forms has been 
studied by Peterson and Pullen’’’*? and by MacNeal, and others.’’ 
The process 2;(t) has been suggested for model earthquake motions by 
Shinozuka and Sato’ and by Jennings, and others.** The process 2,(t) 
is the response function of 2;(t). In Fig. 4 is shown a sample member 
of z;(t) with ¢(t) = sin (at/30) and f(t) as the sample member of 2-.(t) 
in Fig. 1. Its response function to a linear filter with a natural frequency 
of 10 rad/s and a damping ratio of 5 percent is shown in Fig. 5 which 
represents a sample of the process x,(¢). Figure 4 clearly illustrates 
that the waveform is enveloped by a half-sine wave which produces a 
strong phase between the times of 17 and 23 seconds. The high-ampli- 
tude tail observed in Fig. 5 is obviously undesirable in modeling ground 
motion. However, notice that this figure shows only the response history 
cutoff at the end of excitation. If free vibration is allowed after the 
termination of the input, the highly amplified portion will gradually 
decay, and the resulting waveform will then compare more favorably 
with real ground-motion records as shown. 

A nice feature of process x;(t) is its separable property which greatly 
simplifies the mathematics required to evaluate the response statistics. 
Furthermore, the envelope function ¢(¢) can be chosen so that the pat- 
tern of the rise and fall of the simulated waveforms is similar to that of a 
real earthquake motion. However, because the choice of (é) is arbitrary, 
when using z;(¢) the associated nonstationary effects resulting from the 
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Fig. 4—Sample function of process zs(t). 
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Fig. 5—Sample function of process z¢(¢). 


total time duration, the time proportion of the three distinct phases of 
the ground motion, and the rate of buildup and decay must be carefully 
examined. 

The shot noise x;(é) and the filtered shot noise z,(¢) are the nonsta- 
tionary counterparts of the stationary white noise 2,(t) and filtered 
white noise 2z,(¢), respectively. The nonstationariness is introduced into 
these models by two sources: the time-dependent mean arrival rate 
B(t) and the time-dependent amplitude joint probability density func- 
tion p(a; , t;; a; , t;). However, it is assumed that the impulse ampli- 
tudes are completely uncorrelated, that is, the joint probability density 
function is separable: 


D(di, tj} de, te) = par, ti) p(a2, te). 


Further, the probability of m impulses in a small interval dt is negligible 
for n 2 2. Based upon these conditions, it can be shown that the covari- 
ance functions of x7(t) and xg(é) are also time-dependent: 


CH i= if ho(ty — holt, — 2)Ela°(x)\6(r) dr; 6) 


Cott.) <= i 6(t, — 7) (t, — 7)E[a°(x)]8(2) dr 


= Efa*(t,)18(t) 5(t, — te) 
= I(t,) 6, — t); (7) 


where I denotes the appropriate time domain, and [(¢) is the strength 
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function of the shot noise defined as 
Elxz,(27(t + 7)] = I) (7). 


Notice that, when J(¢) is a constant, both x;(¢) and 2x,(t) become sta- 
tionary. 

The process x;(¢) can be constructed by generating independent gaus- 
sian random variables a, with zero mean and variance equal to I(¢,) At, 
and by linearly connecting them over At along the time axis. The 
process 2s(t) can be obtained in a similar way simply by shaping each 
impulse with the transfer function h(t) according to its definition in 
Table II. Amin and Ang’”’ have used process zg(t) with a second-order 
filter to model earthquakes. Both x;(¢) and x,(¢) are justified on the basis 
of the similarity between real and nonstationary waveforms and on 
the matching (7) of their time-varying covariance functions and (iz) 
of the induced response spectra with those of the real ground-motion 
data. 


2.3 Linear Models 


Special cases of the mixed autoregressive-moving average process 
x, of order (m, 7) as defined below also can be used to model ground 
motions: 


t= De Gites +o.+ > O:91-: 5 t= 0, +1, +2,--- (8) 
i=1 i=1 


where ¢; and 6; are characterization parameters, and process {g,} is a 
white noise. An m-order autoregressive (ar) process is given by the first 
sum of equation (8), that is, 


Ly = D Oihe-i Gs (9) 
i=1 
and an n-order moving average (ma) process by the second sum 
LX, = Gt > O:91-5 . (10) 


a=1 

The ar processes given in equation (9) are particularly useful in time 
series simulations because they are very flexible and can be used to 
model a wide range of real-world random data. For example, the auto- 
correlation function of a second-order ar process, involving only two 
parameters, can produce a wide variety of autocorrelation functions. 
Therefore by matching the ground-motion autocorrelation function of 
the damped oscillatory type, one can estimate parameters ¢; and fit 
the observed motion to an appropriate linear stochastic model. 
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III. RESPONSE ANALYSIS 


Because a ground-motion model when chosen will be used to specify 
vibration environments for structural testing and design, it is important 
to examine its effects on the time and frequency response of some rep- 
resentative systems. In what follows we shall compute and compare the 
mean-square response of a class of second-order linear systems to stochas- 
tic inputs represented by models as described in the previous section. 
The linear systems are characterized by two constant parameters, the 
damping coefficient ¢ and a natural frequency w, , and have transfer 
functions 


h(i) = exp (— fw, t) 
(t) ee 
= 0 tb =<0: 


sin pt, i =0; (11) 


where p = w,(1 — ¢°)}, 
Let the response function to z,(¢) be y;(t);7 = 1, 2, , 8, for systems 
defined by equation (11). The mean-square response is egg by 


Bly. O"] = ff nie = ace = wgile, 2”) de ae" 


prt Deke Be. 12) 
The function g,(r, 7’) for each model is 
9: = 2S 5(r — 7’), 


go = R(t — 7’) = an [ ho(Dho(t + + — 7’) at, 


ds = Raslr — 1!) = | 00) lr — 7) + Soledad — DY, 


g. = 4 Do rr'a} exp (—a,(r + 7')) cos w,(r/ — 7), 
1 


9s = b(7)b(r) R(t — 7’), 


sa ff hole — a)holr” — 05)6(0,)6(0.)F,(02 = 8) d8, dB, , 


Q 


BOG) i =A) SIG 4@ = a, 
é i ho(r — 6)E[a(6)]8(6) do 2 hor’ — 6)E[a(#)]8(6) 0 


&Q 


SQ 
rr) 


Ee [ ho(r — O)ho(r’ — 0)E{a?(8)18(8) a9. (13) 
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The explicit expression for the mean-square response to stationary 
models can be obtained by integrations using equations (11) through 


(13): 








ae tSo 
BU] = Fee + aoe 
Es cos 2pt — (1 — £°)? sin 2pt — 1/¢) exp (—2~e,t), (14) 
TS,2(n) 
By) ~ 8 


, E = exp (at {[p? + 2(w,f)?sin® pt + wpe sin apt} | : 


(15) 


It is assumed in equation (15) that S,.(w), the power spectral density 
of x(t), is given, and the main contribution of x.(t) to the response 
comes from the region around w = w, .”° And: 


E{y3(t)] = Be, + 6 exp (20) |e cos 2pt + c; sin 2pt 


Bp p22 2, Bpay 
” (San, — a’) sin’ pt + — cos’ pt Sete. | 





28 p + a)i)[(a + fa) sin pt +p cospt] (16) 


in which a = (1 — p)B, uw = @ + (1 — 28*)on, y = (a? + of)? — 
4a7%?w? , and 





= £2 ( st — Ht) evils 
oy one od) ae 

ati =f, (eat 2) abet | 
=| ( 7 2¢ 1 y 

_ 1[Be¢ ae e600) | 
co = 2 [BE Ga, + at) ae \g v 


Notice that, as time increases, mean-square response to each of three 
stationary models approaches its steady-state level, that is, 


1So - 
| Qtooe ; pet 
: qr. 2 Tv 22(Wn) . 
tim Bye] = FS2G2, i =e a7 


Cy , 1= 3, 
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Let the rate of convergence of the mean-square response be defined as 


lim Efyi()] — Ely] 
6 Tim BOT “ 
and N = w,t/2m be the number of cycles of the motion required to reach 
e;.. A lower bound to the estimate of N can be easily established for 
processes x,(¢) and x,(¢) as the following: 


1,f1+e¢°4+ca— °°} 
N 2 it in| i — ee 


From this it is noted that N is independent of the natural frequency 
w, of the system but is heavily dependent on the damping ratio ¢. Figure 
6 shows that systems with high damping, when excited by 2z,(é) and 
x(t), will approach steady-state level faster than those with low damp- 
ing. A system with 10 percent damping will reach 90 percent of its steady- 
state response in two cycles of motion. 

Because the mean-square response to 2;(¢) involves more parameters 
than that to 2,(¢) or x(t), the response convergence rate for x3(¢) is 
more difficult to evaluate. However, ¢ remains as the dominant factor, 
not 6 or p. The mean-square response of x;(t), as of x,(¢) and 2,(t), ap- 
proaches its steady-state value rapidly when ¢ is high, slowly when ¢ is 
low. 

Explicit expression for the mean-square response to nonstationary 
models can also be obtained similarly from equation 13 although the 
integration involved in the time domain is quite cumbersome. Bogdan- 


lf O0<¢<1. (19) 
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Fig. 6—Convergence of mean-square response of processes 2(¢) and 22(t). 
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off, and others,’ have shown that 


2 1 . ayy; (t) 
Elys()] = ~3 exp (—2fa,t) DES (20) 
Pp 1 Xi 
where y;(t) and x; are both functions of a; , w; , and p. 

Sometimes it is more convenient to calculate the mean-square re- 
sponse by integration in the frequency domain than in the time domain. 
For example, Brown” has generalized Miller’s’ result for the process 
x;(t) to the case where ¢(¢) is bounded on (— ©, ©) and integrable on 
every finite subinterval of (—», ©). His frequency formulation is 


Covis (4) = 3 [| Be, 4)B*@, 4)S,@) do @Y) 





ve) ee) 2 

Hye) = ga [| [Hed — a) exp (ist) da | S,() deve (22) 
where H(w), ®(w), and B(w, t) are the Fourier transforms of h(é), ¢(é), 
and A(t — 7)d(r), respectively, and the star denotes the complex con- 
jugate. Barnoski and Maurer,” using equation (21), evaluated E[y?(é)] 
numerically for cases where ¢(¢) is the unit step and rectangular functions 
and f(t) is both white noise and noise with an exponentially decaying 
harmonic correlation function, that is, R;(r) = A exp (—a| 7 |) cos br. 
It was shown for white noise modulated by a unit step function that 
the system mean-square response will not exceed its stationary value 
for white noise. For correlated noise modulated in this same way, the 
system mean-square response may overshoot its stationary value. Note 
from equations (13) and (21) that 


ga(7, 1’) = Cov,s(z, 7’). 


Substitution of this relation into equation (12) yields 


Ely2()] = i i; DRG = ore eres 


= 2 i [ aa Gua) ae Sp eee 


-Covys (7, 7’) dr dr’. (23) 
Substitution of g, in equation (13) into equation (12) yields 


Ety3(] = = exp (=2¢e,t) | 1(2) exp @fear) dr 


= [ I(r) exp (2fw,7) cos p(t — 7) dr. (24) 
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Using the relation g(r, 7’) = Covy7 (7, 7’) and letting h,(é) with param- 


eters W), >, and py be of the same form as A(t) in equation (11), it 
can be shown that 


Elys()] 


1 ? 
= op exp (—2fw,1) 
f ip {exp [(Swn — fowo)(r + 7’)] sin p(t — 7) sin p(t — 7’) 
‘ | co Dot — 7’) i I(6) exp (2 fou) dé 


— [ I(6) exp (208) cos po(r + 7’ — 26) aol} drdr’. (25) 

It should be noted that, in equations (24) and (25), I(r) = Ela’(r)]8(r). 
The mean-square response to linear first-order moving average and 
autoregressive processes (assuming a sampling interval At) for first- 
order and second-order filters are also found. Let the transfer function 
for the first-order filter be h(t) = exp (—aot) (corresponding to a dif- 


ferential operator p = d/dé + a,) and that for the second-order system 
be as given in equation (9), we obtain for the first-order ma process 


Ely] = on [1 + 6%) — q6,] — exp (—2a,i)), (26) 


(first-order filter); 


Bly"(O] = gop exp (—2en! 
2 1 
da a wo 3 (exp (2fw,t) — 1) — £ exp (2 Sc) 
+ ¢ cos 2pt — (1 — ¢)? sin apt | 
+ af a — °°) sin 2pt — £ cos 2pt 


+ £ exp (2fw,t) + : (1 — exp sun) |b ’ (27) 


(second-order filter); 
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and for first-order ar process 





areca] = — 2. LL = @: exp (a))‘Ii(exp (= a0)¢1)' — 1 
ily (t)] “3 i. 6° (In do)" _ az ’ (28) 


(first-order filter) ; 





ar 2 _ [exp (—4a,t)(—a, sin pt — p cos a,t) + p] 
Hy! = (1 — ¢i)p’(ai + p*)(az + p’) 


HERD AT Se SE ee (29) 


(second-order filter). 
In the above 
AtE( gi), 
q = 2 exp (a Ad), 
a, = fo, + Ing, , 


a = fw, — Ing, . 


| 


c 


It follows from equations (26) and (27) that the mean-square response 
to the first-order ma process approaches a steady-state value 


lim E[y?()] = on ree (first-order filter); (30) 
Ato Ao 

_ el + 6) : 

Saas 3 (second-order filter). (31) 


Similarly from equations (28) and (29) 


; 2 ae ae eT , 
ao! awe (age ees Oe 


(first-order filter); 
I 


(second-order filter). 


The above results indicate that the mean-square response of linear 
systems to elther of the ar and ma processes approaches a certain sta- 
tionary value when the time of passage is sufficiently long. 
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IV. CONCLUSIONS 


When selecting a stochastic model it is important to consider not 
only the matching of statistical characterizations of real-world random 
data to those of the model, but also the effects of the model on vulner- 
able structural systems. The statistical characterizations are provided 
by joint probability distribution functions of the process conditioned on 
its duration and intensity. Ordinary power spectra and time-variable 
spectra such as the running spectrum 


t 
Sw, ) = | aa) exp (—twr) dr 
0 
or the instantaneous spectrum 
p(w, t) = cs | S(iw, t) |? 
) ot ? 


can be used to characterize and form the simulation basis for the sta- 
tionary and nonstationary processes, respectively. For the latter case, 
a second variable enters into the spectrum formulations and therefore 
complicates the analysis considerably. One alternative for analyzing 
nonstationary processes is to follow Priestley’s theory of evolutionary 
processes and spectra.” Its applicablility to ground motion and 
earthquakes will be investigated in a separate report. In general one 
must exercise engineering judgment upon consideration of the specific 
problem he studies in making an intelligent choice among all possible 
models. At the present time it appears that an earthquake ground- 
motion accelerogram can reasonably be treated as sectionally stationary 
when broken into three distinct phases. Each phase of the motion can 
be regarded as a short process and the corresponding power spectral 
density estimated by standard approaches to form the simulation bases 
for the z,(t) model. The applicability of this procedure is illustrated in 
Fig. 7 which shows the power spectrum densities associated with three 
distinct phases of recorded S21W ground motion during the Taft, 
California, 1952 earthquake. It is apparent from this earthquake that 
most of the input power to structures is provided by the midsection 
(from 3.3 to 13.6 seconds) of the motion. The power contained in low- 
intensity fluctuations preceding and following this stationary portion is 
relatively small. 

_ Finally it should be pointed out that the stochastic models investigated 
in this paper can be easily realized by using a computer. The response 
statistics of these models are also reasonably easy to find. Although the 
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Fig. 7—Power spectral densities of Taft, California, S21W, July 21, 1952 earthquake. 


current study is concerned primarily with ground-motion simulation, 
the results obtained can be applied also to many other engineering 
problems when time series modeling is required. 


REFERENCES 


1. 


re WC bd 


co ON DO &H 


11. 


12. 


Liu, 8. C., “Statistical Analysis and Stochastic Simulation of Ground Motion . 
Data,’’ B.S.T.J., 47, No. 10 (December 1968), pp. 2273-2298. 


. Bycroft, G. N., “White Noise Representation of Earthquakes,’’ Proc. Amer. 


Soc. Civil Engineers, 86, No. EM2 (April 1960), pp. 1-16. 


. Housner, G. W., and Jennings, P. C., Jr., ““Generation of Artificial Earthquakes,’ 


Proc. Amer. Soc. Civil Engineers, 90, No. EM1 (February 1964), pp. 113-150. 


. Liu, S. C., and Jhaveri, D. P., ‘Spectral Simulation and Earthquake Site Prop- 


erties,’ J. of Eng. Mech. Div., Proc. Amer. Soc. Civil Engineers, 95, No. 
EM-5 (October 1969), pp. 1145-1168. 


. Franklin, J. N., ‘“Numerical Simulation of Stationary and Nonstationary Gaus- 


sian Random Processes,’’ SIAM Review, 7, No. 1 (January 1965), pp. 68-80. 


. Leneman, O. A. Z., “Random Sampling of Random Processes: Impulse Pro- 


cesses,’’ Inf. and Contr., 9, No. 6 (August 1966), pp. 347-363. 


. Beutler, F. J., and Leneman, O. A. Z., ‘‘The Spectral Analysis of Impulse Pro- 


cesses,’’ Inf. and Contr., 12, No. 3 (March 1968), pp. 236-258. 


. Moore, J. B., and Anderson, B. D. O., “Simulation of Stationary Stochastic 


Processes,’’ Proc. IEEE, 115, No. 2 (February 1968), pp. 337-339. 


. Bogdanoff, J. L., Goldberg, J. E., and Bernard, M. C., “Response of a Simple 


Structure to a Random Earthquake Type Disturbance,’ Bull. Seismological 
Soc. Amer., 54, No. 1 (February 1964), pp. 263-276. 


. Peterson, H. C., and Pullen, C. L., ‘‘Response of a Dynamic System to a Separa- 


ble Nonstationary Random Excitation,’ J. Spacecraft Rockets, 3, No. 8 
(August 1966), pp. 1299-1300. 

Pullen, C. L., and Peterson, H. C., ‘Spectral Analysis of the Transient Response 
of a System to Random Excitation,’’ Trans. Amer. Soc. Mech. Engineers, 
J. Appl. Mech., 33, Series E, No. 3 (September 1966), pp. 700-702. ; 

MacNeal, R., Barnoski, R. L., and Bailie, J. A., “Response of a Simple Oscillator 
to Nonstationary Random Noise,’’ J. Spacecraft Rockets, 3, No. 3 (March 
1966), pp. 441-443. 


13. 
14, 


15. 


16. 


17. 
18. 
19. 


20. 
al. 
22, 


STOCHASTIC GROUND MOTIONS 541 


Shinozuka, M., and Sato, Y., “Simulation of Nonstationary Random Process,”’ 
Proc. Amer. Soc. Civil Engineers, 93, No. EM1 (February 1967), pp. 11-40. 

Jennings, P. C., Housner, G. W., and Tsai, N. C., “Simulated Earthquake 
Motions,’ Tech. Rept., Earthquake Engineering Research Lab., Calif. Inst. 
Tech., Pasadena, California, April 1968. 

Amin, M., and Ang, A. H. S., ‘A Nonstationary Model for Strong Motion 
Earthquakes,’’ Proc. Amer. Soc. Civil Engineers, 94, No. M2 (April 1968), 
pp. 559-583. 

Caughey, T. K., and Stumpf, H. J.,. “Transient Response of a Dynamic System 
Under Random Excitation,’’ J. Appl. Mech., Trans. Amer. Soc. Mechanical 
Eng., 28, No. E-4 (December 1961), pp. 563-566. 

Brown, J. L., “‘A Correlation Result for Nonstationary Inputs,’’ Quart. Appl. 
Math., 24, No. 1 (April 1966), pp. 938-95. 

Miller, K. 8., “A Note on Input-Output Spectral Densities,’’ Quart. Appl. 
Math., 21, No. 1 (October 1963), pp. 249-252. 

Barnoski, R. L., and Maurer, J. R., ‘‘“Mean-Square Response of Simple Mechan- 
ical System to Nonstationary Excitation,’’ J. Appl. Mech., Trans. Amer. 
Soe. Mechanical Eng., 36, Series E, No. 2 (June 1969), pp. 221-228. 

Priestley, M. B., “Evolutionary Spectra and Nonstationary Processes,’ J. R. 
Statist. Soc. B., 27, No. 2 (1965), pp. 204-237. 

Priestley, M. B., ‘Power Spectral Analysis of Non-stationary Random Pro- 
cesses,’’ J. Sound Vib., 6, No. 1 (July 1967), pp. 86-97. 

Priestley, M. B., and Rao, T.S., “A Test for Non-stationarity of Time-series,”’ 
J. R. Statist. Soc. B, No. 1 (1969), pp. 140-149. 


Limiting Behaviors of Randomly Excited 
Hyperbolic Tangent Systems 


By 8S. C. LIU and D. K. COHOON 
(Manuscript received October 22, 1969) 


We investigate the steady-state probability density distribution of a 
large class of random processes by solving the governing Fokker—Planck 
equation. The random response statistics of a nonlinear single-degree-of- 
freedom mechanical model with hyperbolic tangent stiffness are discussed 
in some detail. The probability density of such systems ts of the sech-power 
type which belongs to a class of distributions whose behaviors are carefully 
examined at the limits where the system parameter b approaches zero 
and infinity. Other important response statistics such as the mean square 
response, zero crossings, and peak distributions are also studied. 


I. INTRODUCTION 


In recent years, random vibrations of nonlinear systems have attracted 
considerable attention among engineers.’ In this paper we investigate 
the Fokker-Planck equations’"® associated with a class of random proc- 
esses whose steady-state probability density distributions, of the Lia- 
punov potential function type. 

The random response statistics of a nonlinear single-degree-of-freedom 
model having a hyperbolic tangent stiffness function can be described 
as a softening spring whose force-deflection relationship is asymptotic 
to some maximum force level. Such a model can be used to represent 
an elastic-perfect-plastic system, material often encountered in classical 
mechanics. Limiting situations for a class of probability density func- 
tions such as those obtained in this study are examined. We show that 
the limiting behavior of the steady-state output probability density 
function of a system having a generalized hyperbolic tangent stiffness 
function, F(u) = (k)/b*~*) tanh bu, is closely related to the range of the 
parameter a. At the limit b — o, the probability density function be- 
comes a Dirac delta (impulse) function or an exponential distribution, 
or identically approaches zero for all wu, depending upon whether a 
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is less than, equal to, or greater than 1. At the limit b — 0, it vanishes 
identically for all wu and becomes a normal distribution or a Dirac delta 
function, depending upon whether a is less than, equal to, or greater 
than 2. In addition, we study statistics of other response parameters 
such as the mean square output, zero crossings and peak output dis- 
tribution, which are relevant to the control of the failure modes of the 
system. 

The motion of a dynamic system under purely random disturbance 
is described by a Markoff process y(t) = [y,(é), y2(é), --- , yn(é)] in the 
n-dimensional phase space. It can be shown” that for the initial con- 
dition 


ply.) = II 8s = ¥:0) 


where y, is the initial state of y(t) and 6 is the Dirac delta function, the 
conditional probability density function p(y | y. , ¢) of the process y(t) 
satisfies the forward Fokker—Planck equation, 


Op —. OG,(y) 
where 
— ¢ 
Gy) = Aiy)p — 3 ae. [B:;(y)p] (2) 
is the component of the probability current vector p(y | y. , ) in which 
A,{y) = lim (Yi.at — Yi) (3) 
and 
By) = Lim (Yi,ae — YsYi,ae — Yi) (4) 


are intensity coefficients depending on the input and the properties of 
the system (the bracket indicating ensemble averaging). 

We are interested in the solution of the steady-state equation (1), 
that is when dp/dt = 0, for cases where all generalized response variables 
of a system in the 2n phase-space coordinates are independent of one 
another. For this type of motion it is sometimes possible to find appro- 
priate partial operators which, when linearly operated on functions of the 
type gi(y.)p + hi(y:)(Op/dy:), generate an equation equivalent to (1). 
More specifically, the steady-state equation (1) can be put in the form 


p2 Lal ouude + hily) 2e_| = 0 (5) 


NONLINEAR RANDOM MOTION 545 


where the coefficients L; are arbitrary first-order partial-differential 
operators. If there exists a p(y) independent of initial conditions and 
satisfying each 


fe) . 
gi(yi)p + hi(y:) 7 = 0, @ = i 2, saa 3) 2n), 


then by Gray’s uniqueness theorem such p(y) is the unique solution of 
equation (5).° Such a solution is 





ply) =C U exp |- a ae a. | (6) 


and Cis the normalization factor. 
Equations (5) and (6) will be used in the following sections to analyze 
a class of nonlinear systems. 


Il. HYPERBOLIC TANGENT STIFFNESS MODEL 


The mechanical system considered in this investigation is a single- 
degree-of-freedom oscillator with a mass m, a linear viscous damping 
c, and a nonlinear spring function F(u). When the system is subjected 
to a base acceleration excitation #,(t), its response is characterized by 
the displacement u(t) relative to the base. The equation of motion of 
the system is 


ui + 26% + F(u) = ald) (7) 
where 
sphere _ Fw 
B ma 2m ) ¥(u) 4 m ) 
and 
a(t) = —#,(i). 


Let a(t) be a gaussian, stationary white noise with zero mean; that is, 
with the properties 


(a(t)) = 0 
(a(t,)a(te)) = 28, (t; — te) 
where S, is the constant power spectral density of a(t). Then the as- 


sociated steady-state Fokker—Planck equation for u(é) = [w(t), w(t)] is 


S. 57 Pee, t) — 5 [tipu, W] + $ {128% + F@]}pe, a) = 0. ©) 
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For this two-dimensional case (n = 2), according to equations (5) 
and (6), the solution can be written down readily, 
9 +2 u 
plu, %) = C exp (22 E ae ( 5) ae|} (9) 
wS, L2 5 


where C is the normalization factor determined by 


ff ve, u) du du = 1. 


A special kind of softening spring described by a hyperbolic tangent 
function will now be considered. The force-deflection characteristic is 
shown in Fig. 1 and given as follows: 


Fu) = #: tanh bu, k,b>0, (10) 


where k, is the initial stiffness, and b is the rate of convergence of the 
force-deflection curve. 

It should be noted that the spring force F(u) developed during the 
motion is bounded between k,/b and —k,/b. Therefore k,/b may be 
regarded as yielding force and 1/b the corresponding yielding displace- 
ment. The stiffness function F'(u) described in equation (10) then pro- 
vides a good representation of the elastic-perfect-plastic behavior often 
encountered in the fields of classical mechanics and structural en- 
gineering. 

Let w? = k,/m where w, represents the natural frequency of the linear 


F(u) 
Ko /b 
ie) / by bo bs 
/ 
/ 
J 
y b,>b2>b3>0 
U 
J 
1 
: -k o/b 


/ 


Fig. 1—Force-deflection relationship of hyperbolic tangent stiffness model. 
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oscillator with stiffness k, ; then substitution of equation (10) into (9) 
yields 


2-2 
plu, u) = C exp {sts — oe In cosh bn} (11) 


where o, = (7S,/26w?) is the variance of the linear response [that is, 
if F(u) = k,ul. 

Equation (11) shows that u and w are statistically independent. The 
probability density function for velocity « is normal with zero mean 
and variance o?w? , that is, 


o~"o } 


eae ee ses) 

pu) = (Qn), exp ( Fort) ? = Ae A | a (12) 

The probability density function for the displacement w is 
p(u) = C,(b)[sech bu]’7?""* (13) 

where 
co) = 

C,(b) = ( i sech’”’”” BE at) (14) 
Because (sech bé)'”°*’’’ converges to zero very rapidly as — > o, 


C,(b) in equation (14) can be evaluated numerically for any positive 
b. If 1/b’c? is an integer, equation (14) then becomes 
b D-1 


J] 2D — 2k — 1) (15) 


C0) = SoD — Ht As 


where 2D = 1/b’o? are integers.” It is interesting to see that, if tanh bu 
is expanded into a power series, equation (13) then becomes 


| ae ae . 
plu) = C408) exp | sx (wt — Eu + --)], lulsa, 


which indicates that a cubic softening spring with nonlinear coefficient 
k,b'/3 is the first approximation of the hyperbolic tangent spring. 

Values of p(u) given by equation (13) for various 1/b’o? are shown in 
Figs. 2 and 3. 


Ill. LIMITING SITUATIONS OF p(u) 


In connection with the examination of the limiting behaviors of 
p(u) in equation (13), where the parameter b approaches zero and in- 
finity alternately, three useful theorems are presented. 
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Fig. 2—Sech-power probability density distributions. 





Fig. 3—Sech-power probability density distributions. 
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Theorem 1: Let f,(x) be a sequence of nonnegative density functions 
integrable on [— ~~, ©]. Suppose there exists a sequence of positive inte- 
grable g,(x) such that 


an(a) & Pala) = tole) | [ 18) a 


and 


lim i gn(x) dx + | Jn(X) ie | = 0 forevery «> 0. 


n=O 


Then 
lim F,,(x) = 6(z), (16) 


nO 


the Dirae delta function. 
Proof: We must show that, for every h in C%(R), the space of test 
functions 

lim ; F,(a)h(a) dx = h(0). 


By the mean value theorem the following relationship holds: 


jini | "Fon de 


no 


in | ely On eae / iG) de ean KO 


. [ F(a) dx 


where é is some member of [—e, e], depending on e and n. The first two 
limits on the right side of the previous equation are zero by a comparison 
test; therefore, one can show that 


lim | F(x) dx = 1. 


nc 


Then 


inne Sin / RWS ae 


no n 


But the right side is independent of ¢. Thus, letting « approach zero, 
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we deduce that 
iO) 22-limn i Fn de: 


which completes the proof. 
Instead of considering p(u) of equation (13), we shall investigate 
its more general form as 


[sech (bu)]'7?°4 


Pi,a(U) = a ) 
i [sech (by)]'°"* dy 


which is the steady-state displacement density function corresponding 
to a generalized hyperbolic tangent stiffness function 





FQ) = = tanh bu (17) 


ifA =o. 
Theorem 2: Let pa(u) = limyo Do,a)(u), then 
(4) a > Limplies p,(u) = 0, 


(ti) a = 1 implies p,(u) = (ies, 
and 

(itt) a < 1 implies p,(u) = 6(u). 
Proof: First suppose a > 1. We observe that 


[Po.a@) |S ———— forall u, 


[ [sech (by)]'”’"* dy 


but 
[sech (by)]"”°"4 = exp (—| y |/b* A), 
thus 


J tsech Opr’*4 dy = [exp (—[y [/0 A) dy = 207A. 


Thus, since 
| Dea, (U) [s 1/(2b*~*A) (18) 


for all u, we conclude that limy.,, p¢3,2)(u) = 0. 
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Now suppose that a = 1. Then 
lim In [sech (bu)]'”°* = lim (1/0DA) In (sech bu) 
b-00 b-00 


lim (—1/bA) In (cosh bu) 
b-00 


I 


lim [—tanh (bu)/A] = —|u |/A. 


Thus, 
lim [sech (bu)]’’4 = exp (—| u |/A). 


By the Lebesgue dominated-convergence theorem 


fe) 


lim [sech (by)]*”"* dy = [ exp (—| y |/A) dy = 2A. 


b—00 a 


Thus, 
lim Posy) = (2A)™ exp (—|u |/A). 
Finally, we suppose that a < 1. Let 
gen* exp (—|u |b" /A) 


G(s, a) (U) _ 0 
[exp [-@" | y D/Al dy 


or, equivalently, 
Qibeapi-a) 


Jwo.ayU) = ee) exp (—|u | b°°@/A). 


Then, since 
lim J gu.) dy = lim f go.) dy = 0 


for every « > 0 and 
Jw,a)(U) 2 Do,ay(u) forevery 4, 
we conclude from Theorem 1 that 
lim Pw,aU) = Su), 
and the proof is completed. 


Theorem 8: Let pi(u) = limyoo Do.a)(u), then 
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(1) a > 2implies pZ(u) = 6(u), 
(it) a = 2implies p{(u) = normal distribution with variance o? , and 
(1tt) a < 2implies pJ(u) = 0 for all u. 
Proof: The case a > 2 implies p/(u) = 6(u) is proved in Appendix A 


in which we also show that there exists for every ye (0, 1) aC, > O such 
that 





2 
g,(u) = C, exp (4 Jeo) 
L/bOA 
> —_I[sech bu] "tay Cae 1, 


[Goch (oy "4 dy 


It follows from the above that 
piu) =0 for l<a< 2. 


From equation (18) we immediately have p’(u) = 0 fora < 1. Now we 
have only to consider the cases when a = 2 anda = 1. In Appendix B 
we show that when a = 2, pZ(u) is a normal distribution with variance 
o.. In Appendix C we show that when a = 1, pZ(u) = 0 for all u. 
Therefore the proof is completed. 

According to Theorem 8, for p(u) given by equations (13) and (14), 
it follows that 


2 


lim p(u) = one exp |-#| , a normal distribution, 


6-0 o 


and according to Theorem 2 


lim p(u) = 0. (20) 
bo 
At the limit b > ©, the yielding force k,/b — 0, that is, the system 
becomes perfect plastic. Thus one may expect an equal probability for 
all u on[— «©, «], as equation (20) indicated. As b > 0, then k,/b > ~, 
the system remains elastic on [— ©, ©] with the initial stiffness k, . It 
is well known that for linear systems the response probability distribu- 
tion is gaussian, which agrees with the result of equation (19). 
It is of interest to note that a similar force-deflection relationship as 
shown in Fig. 1 and as described by the hyperbolic tangent stiffness 
function given in equation (10) can be described by a full-wave smooth 
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limiter which is 


Gu) = he | exp (- 25) dn 


in which d? = 2/zb’. 

It will be noted that in the above equation, G(u) is proportional to 
the integral of a gaussian probability curve. Function G(u) can also be 
used to evaluate the probability density function if made equivalent 
to F(u) as given by equation (10) when both G(u) and F(u) have the 
same initial slope and spring resistance limits. 


IV. OTHER IMPORTANT RESPONSE STATISTICS 


The failure modes of a mechanical system are generally controlled 
by response parameters such as the mean square displacement, zero 
crossings, or the peak displacement distributions. These response sta- 
tistics are closely related to p(u) and will be briefly discussed. 

The mean value of displacement response u vanishes because p(w) 
in equation (13) is an even function. The mean square or the variance 
of the displacement is given by 


ox(b) = (u’) = , é up(u) du 


= 2C,(b) i u’ sech’””’”” bu du, (21) 


which can be evaluated in the following manner*: Let 
is) 2az 
IG) = i e a 
-« (cosh x)°” 


then it can be shown’ that 


_ {x)'T0) 
1O= TED 
and 
a eee _ ms 
iz (cosh x)” F da” ro) 250) ¥'@), 


where ¥’(v) = (d/dv)[I’(@)/T()] is the “‘trigamma” function and has 
been numerically tabulated.” 


* This is pointed out by 8S. O. Rice. 
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From the above results and setting « = bu and »v = be, in equation 
(21) we finally obtain 


o2(0) = 553 CxO)TOY (bo). (22) 


Again according to Theorem 8, it is noted that 


lim 62(b) = 6, 
6-0 


and from Theorem 2 that 


lim o2(b) = ©. 
b-00 
Thus the mean square response o2(b) with such limiting behavior can 
be illustrated as in Fig. 4. 
The expected number of zero crossings v* with positive slope per unit 
time (that is, the expected frequency) can be evaluated according to 
Rice, 


vo(b) = [ : up(0, %) du = a (=) (23) 


where C,(b) is given by equation (14). 
Also according to Theorem 3, it can be shown that 


lim »3(b) = 


va D 
’ 
b0 2a 


(24) 


which is the frequency of the linear system. 


0 y2/0 9? —> 


/b => 


Fig. 4—Variation of mean-square displacement response. 


NONLINEAR RANDOM MOTION 555 


The probability density of the peak amplitude of u(t), from equation 
(13), is given by 





| dp(u) 
pla) = —1 Me tacs 
[pu)Iueo 


= “ (sech ba)'’”’’”* tanh ba. (25) 


By the same argument used in the proof of Theorem 2 it can be 
shown that 





lim p(a) = 6(a), (26) 
b00 
and it follows from Theorem 3 that 
lim p(a) = lim (ten ba) lim sech’””"”** ba 
b-0 b—0 To b-0 
a 55) 
gf es (= ; 27) 


which is the Rayleigh distribution as expected because at this limit 
(b — 0) the system becomes linear. The peak probability density dis- 
tribution p(a) for various b in equation (25) is illustrated in Fig. 5. 
Notice that for all cases p(a) approaches zero at large a; however, the 
rate of fall of p(a) is reduced as b is increased. 
It should be noted that when a = 1, the forcing function described 

by equation (17) approaches a sgn function as b > ©, that is 

lim (&, tanh bu) = k, sgn u. 

b—00 
Therefore, by taking appropriate limits to the density function pre- 
viously obtained for second-order systems with a general hyperbolic 
tangent forcing function, we obtain the steady-state solution for the 
response density of systems governed by the following equation 


a + 264% + k, sgn u = a(t). 


The response density for the above equation is given precisely in state- 
ment (27) of Theorem 2, which can also be verified by using equation (9). 
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APPENDIX A 


Partial Proof of Theorem 3 for Case a > 2 


We claim that if a > 2, then 


1/be%A 
ie sech (bu) 


: = d(u). 
ie / sech (by)'”’"“ dy 


Proof: In view of Theorem 2 we have only to find functions 


gu(u) = sech (bu)'”?*4 
b re 0 


- sech (by)'’"* dy 
such that for every « > 0 


lim gu) du = lim ii g.(u) du = 0 
b-0 b-0 0 


€ 


and such that sup f%,, g,(u) du < «. We write 
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sech (by)'”’"“ = exp {—In [cosh (by)]/b* A}. 
We observe that if | by | < 7/2, then 


I 


In [cosh (by)]/b7.4 >» (1/b° A)(1/)| tim (4) ee con |v 


I 


k~1 
> (y/b* Ak!) im (4) tanh cw | b* 
We now make use of the fact that | by | < 1 implies 


tanh (by) = > B,(—1)"**2°"(2"" — 1) sae 


Thus, there is for every ye (0, 1]a C, > Osuch that | bu | < yr/2 implies 
sech (bu)'”“* < C, exp (—u’/b* A). 


? [ Ceacr 2 exp aa) ty 


= 277A, 


Thus, since 


S 9 <a 
Clewrecm) & 


IV 


we therefore take 
g(u) = C, exp (—u’/b*~7A)2b° "A for [ul < yr/2b 
and 
gy(u) = 2b°-*A sech (bu)'”?** for |u| > yr/2b. 
Note that 


[ go(u) du S 2b°"'A pe (it) sua (tien 
y w/2b : 2b ab 


hyn 1/beA 
=p A 3 (kyr) sech (a) 
=A 2 
<2) A. 
Thus, for a > 2 


yr /2b 


lim [ g,(u) du = lim | C, exp (—u’/b**A)2b° "A du 
6-0 € b-90 € 


heya 1/b7A 
+ lim 20° A oD (ky) sech (be "| 


6-0 
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— 715 Yr 2 a—2 a-1 
= lim= C, exp (—é /b* A)2b° "A + 0 
b-0 2b 
= 0. 


Also, we observe that 


lim g,(u) du = lim [ g,(u) du = 0. 
b-0 € 


6-0 0 
APPENDIX B 


Partial Proof of Theorem 3 for Case a = 2 


Let p(x) = 6(b)(sech bx)’ , b = O for all x on[— ©, ~]. We will 
first show lim,.. 6(b) = 0, then lim,» p(x) converges pointwisely to 
a normal distribution with zero mean and variance o? . 


Proof: From the definition of p,(x), it follows that 
p(x) = {exp [In 6(b)b’o%](Sech ba) }""""" 











In pala) = In (0) + SEED Pe, 
Then 
int Weteh be i 
b0 b Fo b0 2b; 
by L’Hopital’s rule. Thus, since 
._ tanh bx 
lim 7 = 4, 
6-0 
we conclude that 
2 
. x 
ure In po) = 352? 


or that 
2 
lim p,(x) = exp (-5) ; the normal distribution. 
b-0 To 


By using these expressions and equation (17) we can conclude that 
pZ(u) is a normal distribution with variance o? when a = 2. 


NONLINEAR RANDOM MOTION 559 


APPENDIX C 


Partial Proof of Theorem 3 for Case a = 1 


We claim that, when 


sech (bu)'/°4 
Dio) = pene ; 


[ sech (by)'”"4 dy 
then 


lim pv,i(u) = 0 forall uw. 
6-0 


Proof: We observe that 


h bu 1/bA 
Pow) S ee eo) 


i sech (by)'”"* dy 


for all positive integers N. 
We show that for every N > 0 there is a » > O such that b < wimplies 


Pow) S 1/2N. 
We can show, using L’Hopital’s rule, that 


lim sech (bu)'”°4 = 1 
6-0 


for all u and A. Thus, for every » > 0 no matter how small and every 
N' = N(1 + )/( — 7) we can show that there is a » > 0 such that by 
taking b < yp, we have 


lr... 


Pw.) S 7 
(1 — ) dn 
- 


Thus, b < yu implies 


MENG) ah 
Pow) S (t — 7) \an’ Ss oN 


Thus, for every N > 0 there is a » > O such that 0 < b < yp implies 





1 
Pow) S oN’ 
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Hence 


lim Po.) = 0. 
b-70 


The proof is completed. 
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Masking of Crosstalk by 
Speech and Noise* 
By TAPAS K. SEN 


(Manuscript received September 24, 1969) 


We performed three laboratory experiments of crosstalk thresholds using 
simulated telephone conversations. Two of these experiments involved 
masking of crosstalk by noise; the third involved masking of crosstalk by 
both noise and primary speech. In this paper, we present intelligibility and 
detectability threshold data from these experiments and discuss the use- 
fulness of the intelligibility threshold data for determining telephone cross- 
talk objectives. 

In general, the crosstalk threshold versus masking noise functions ob- 
tained from these experiments agreed fairly well with similar functions 
published earlier. These functions were found to be linear for high values of 
noise (about 20 dBrnC and higher) and markedly nonlinear for lower values 
of noise. For very low noise conditions (about 5-6 dBrnC or lower), crosstalk 
thresholds were almost independent of noise. Intelligibility thresholds were 
found to be 8-10 dB higher than the corresponding detectability thresholds 
and a difference of the same size was found between threshold values ob. 
tained (1) with background novse and (it) with both background noise and 
background speech. 


I. INTRODUCTION 


1.1 General Background 


In the process of transmitting speech over telephone channels, a 
portion of the speech energy occasionally gets transferred from one 
channel to another. This transferred energy is technically referred to as 
crosstalk. The presence of crosstalk in telephone circuits is objectionable 
for two main reasons. (7) Its presence may indicate to customers that 
they are recelving a telephone service which does not protect their 


* The material of this paper was presented before the 74th Meeting of the Acousti- 
cal Society of America, 16 November 1967; ‘“‘Masking of Crosstalk by Speech and 
Noise,’’ J. Acoust. Soc. Am,. 42, 1198(A)-1967. 


561 


562 THE BELL SYSTEM TECHNICAL JOURNAL, APRIL 1970 


own. privacy. (27) It may interfere with speech transmission and thus 
degrade the circuit quality. 

Since the Bell System strives to maintain a certain standard of trans- 
mission quality and provide privacy to the customers, it is concerned 
with controlling all sources of circuit degradation, including crosstalk 
interference. Designing the telephone plant to guarantee complete ab- 
sence of energy transfer between channels is not economically feasible. 
Therefore, to guarantee privacy and to maintain a certain standard of 
transmission quality, the usual engineering strategy (which is main- 
tained with a high degree of probability) is to limit the crosstalk energy 
below a threshold such that (2) it is not intelligible and (77) it does not 
subjectively degrade the circuit quality. This threshold is experimentally 
determined by subjective testing, using simulated telephone connections. 
It is then translated into engineering terms in the form of a transmission 
objective. 

Prior to the completion of the tests reported here, crosstalk objectives 
for the telephone plant were based on the results of subjective tests 
conducted at Bell Telephone Laboratories about 30 years ago.’ In the 
intervening period, however, there have been changes in the telephone 
plant, including the introduction of 500-type new telephone set and the 
3A noise measuring set. Although it would have been possible to con- 
tinue to use the previous data with appropriate conversion factors, a 
new series of tests was undertaken. This was done even though the 
difference between the near and earlier results was expected to be small, 
because small differences in objectives, even in the order of 1 dB, can 
indeed have important economic consequences in new designs. 

One of the important areas of application for the present crosstalk 
data will be design requirements for new telephone sets. Here, the 
state-of-the-art now promises the possibility of increased telephone set 
gain at low cost. However, it also appears that loop crosstalk considera- 
tions will probably limit the extent to which this gain can be used to 
achieve economics in other parts of the plant. In order to facilitate 
studies of this type, it was considered important to have accurate and 
up-to-date subjective test results. 

In addition to providing for the revision of the earlier crosstalk test 
results for the intelligibility threshold, the new test series afforded the 
opportunity to obtain data on the threshold of detectability and on the 
masking effects of speech as well as noise. Other factors which were 
considered worthy of study were differences between one-word and 
several-word intelligibility and the effect of letting the subject control 
the crosstalk level. 

The primary results of the study are in terms of crosstalk coupling 
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loss which is flat with frequency in the band from approximately 300 
to 3300 kHz. In order to apply the results to systems where capacitive 
rather than flat coupling exists, correction factors must be applied. 
Appropriate correction factors, based on the results of a comparison 
study, have been included in Section III of this paper. 


1.2 Purpose of the Experiments 


In order to check the adequacy of the existing crosstalk objectives, 
transmission engineers need, among other things, psychophysical data 
on speech intelligibility thresholds for various background noise con- 
ditions. Experiment I was designed to collect psychophysical data of 
this kind; that is, data which could be used by transmission engineers to 
set transmission objectives for crosstalk. 

Experiment II was designed to obtain data on crosstalk thresholds 
with both noise and primary speech on the circuit. The primary purpose 
here was to determine the difference between crosstalk threshold values 
obtained with both background speech and noise, and those obtained 
with background noise only. Such information is useful in evaluating 
certain crosstalk phenomenon. However, it should be recognized that in 
most applications, speech may not always be present to provide addi- 
tional masking, and objectives must normally be based on the masking 
effects of noise only. A second purpose of this experiment was to obtain, 
for each experimental condition, a rating by the subjects of the overall 
transmission quality. Data on transmission quality ratings serve as 
important guidelines for establishing Bell System transmission objec- 
tives. This paper, however, presents only the threshold data. 

Experiment JIT had essentially the same purpose as Experiment I, 
but two changes were made in the procedure. First, instead of hearing 
short sentences for crosstalk as in Experiment I, the subjects heard a 
recorded 2-way simulated telephone conversation. Second, instead of 
simply reproducing the crosstalk words heard as was done in Experiment 
I, each subject used his own criterion for determining intelligibility 
thresholds. The purpose here was to find if the threshold values and the 
intersubject variability as obtained in Experiment I could be signifi- 
cantly affected by introducing a somewhat less stringent criterion, 
namely, the subjects’ own judgment about the intelligibility threshold. 


II. METHOD 


2.1 Definitions of Thresholds 


Two kinds of speech (or crosstalk) thresholds were measured in these 
experiments: (2) The threshold of detectability, defined as the speech 
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(or crosstalk) level at which the subject is just able to detect the presence 
of speech sounds with 50 percent probability. (27) The threshold of 
intelligibility, defined as the speech (or crosstalk) level at which the 
subject is just able to understand the meaning of the speech content 
with 50 percent probability. 


2.2 Psychophysical Methods 


Of the various psychophysical methods which can be used for deter- 
mining thresholds, we used two in the present experiments. In Experi- 
ments I and II, we used the Method of Limit. In this, the experimenter 
controlled the level of the stimulus (crosstalk material) presented to the 
subjects. The experiment started with the stimulus at a level well 
below the threshold. The level was increased by small but equal steps 
in subsequent presentations (a 3 dB step was used in this case). The 
series was stopped when the level was well above the intelligibility 
threshold. The next series started with the stimulus at some level above 
the intelligibility threshold and the level was decreased by the same 
step of 3 dB. The series was terminated when the level was well below 
the detectability threshold. At each presentation of the test condition, 
the subjects gave the desired response. For each subject, the midpoint 
of the transition between response and no response determined his 
threshold. 

In Experiment ITI, we used a different psychophysical method, namely 
the Method of Adjustment, to determine the thresholds. This method 
required the subjects to adjust the stimulus level. For each experi- 
mental condition, the subject was first presented with a speech level 
well below the detectability threshold. He was asked to increase the 
level until speech was first detectable and then intelligible. Next, he 
started with a speech level well above the intelligibility threshold and 
decreased the level until it was no longer detectable. 


2.3 Hxperimental Conditions 


In Experiment I, five levels of white noise were presented to the 
subjects. These noise levels, as measured at the line terminals of the 
telephone set, were 18, 33.5, 38.5, 48.5 and 48.5 dBrnC respectively. 
(For explanation of dBrnC, see Aikens and Lewinski’.) Short sentences 
taken from a list provided by Beranek served as crosstalk material.° 
For each noise level, two different sentences were used, one spoken 
by a male talker and the other by a female talker. There were thus a 
total of ten experimental conditions presented to the subjects. 

In Experiment II, the same five noise levels used in Experiment I 
were each combined with five levels of primary speech, thus making a 
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total of 25 experimental conditions. These 5 speech levels as measured 
at the line terminals of the telephone set used were —30, —35, —40, 
—45, and —50 VU respectively. 

For each experimental condition in Experiment II, the subjects heard 
a 30-second simulated telephone conversation between male or female 
talkers which served as the primary speech in the circuit. Short sentences 
like those used in Experiment I served as crosstalk materials. For each 
of the 25 experimental conditions, a different primary speech segment 
and a different crosstalk sentence were used. Both male and female 
talkers were used in both. Thus, a test condition could have only male, 
only female, or a combination of male and female talkers. 

In Experiment III the five noise levels of Experiments I and II were 
retained. However, instead of short Beranek sentences, simulated 
conversation segments between talkers were used as crosstalk material. 

A Northern Electric VU Meter was used for all speech level measure- 
ments. One experienced meter reader made all the measurements 
following recommendations made by Carter and Emling, and as quoted 
by Brady.* 

Equivalent Peak Level (epl)’ measurements were also made on about 
25 percent of the speech samples in these experiments. On the average, 
epl was found to be 10 dB higher than the corresponding VU measure. 
The standard deviation of the difference (epl-VU) was 0.9 dB. 


2.4 Anchor Conditions 


It was mentioned earlier that the subjects were asked to rate the 
transmission quality of each experimental condition during Experiment 
It. In order to give them a general idea of the range of transmission 
quality usually encountered in the telephone plant, selected speech 
samples were presented prior to each test session. This was done to 
anchor their judgment at the extremes of the rating scale. A set of six 
test conditions was thus presented to the subjects at the beginning of 
each test session in Experiment II. These consisted of simulated tele- 
phone conversations between pairs of talkers which were heard by the 
subjects through some very poor and some very good simulated tele- 
phone connections. 


2.5 Room Noise 


The room noise for Experiments I and II as measured by a sound level 
meter was 37 dBt,* A-weighting. The similar value for Experiment III 
was 41 dBt. (Experiment III was performed in a different test room.) 


* dBt = dB relative to 0.0002 dynes/cm?. This measure was referred to as dBRAP 
in earlier crosstalk tests by Edson.! 
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2.6 Experimental Apparatus 


Block diagrams of the laboratory system used in the present experi- 
ments are shown and discussed in Appendix A. 


2.7 Procedure 


Two rooms were used in Experiments I and II. The control room 
contained the equipment required for manipulation during the experi- 
ments; the experimental room contained part of the apparatus and the 
subjects’ booths. A test administrator monitored the test conditions 
using one of 12 parallel receivers in the experimental room. 

Normally, eight to ten subjects took part in each experimental 
session. Before each experiment began, the test administrator reviewed 
the instructions with the subjects. Each subject was provided with an 
instruction sheet before the administrator reviewed the instruction. 

At the beginning of each session, the subjects listened to the six anchor 
conditions. They were not required to make any response to these con- 
ditions. The actual experimental conditions followed these anchor con- 
ditions with a short announcement. To each stimulus condition, the 
subjects were required to take these steps: (z) Indicate whether or not 
they detected any background speech (that is, crosstalk). (27) Write 
down all the interfering words that were intelligible. (727) For Experi- 
ment II only, rate the transmission quality of the circuit on a 5-point 
scale. 

The 25 test conditions in Experiment II were divided into five groups, 
each group being presented in one test session. For each subject, five 
test sessions were required for Experiment II and one session for Experi- 
ment I. Each test session in Experiments I and II took from 90 to 100 
minutes, and was divided into 2 halves by a short break. No subject 
took part in more than one session per day. A total of 24 test sessions 
was required to run all the subjects through Experiments I and II. This 
was spread over a period of 7 weeks. As indicated earlier, the Method 
of Limit was used in Experiments I and II. 

In Experiment III the Method of Adjustment was used with one subject 
at a time taking part in the experiment. Here, the subject was required 
to adjust a variable attenuator for his threshold settings. Each subject 
made two settings each for both detectability and intelligibility thresh- 
old—one for the crosstalk level going up from low volume to high 
volume, and the other for the crosstalk level going down from high 
volume to low volume. 

The crosstalk materials used in Experiment III were two 30-second 
simulated conversations, one between a pair of male talkers and the 
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other between a pair of female talkers. The same five circuit noise levels 
were used as in Experiments I and II. The subjects were given the 
following guidelines for their threshold criteria: (7) For the detecta- 
bility threshold, the level should permit them to detect the presence 
of speech sounds without understanding them. (77) For the intelligi- 
bility threshold, the level should permit them to understand about one 
complete sentence without appreciable effort. For each subject, one 
experimental session took approximately one hour. 

For all experiments, the test conditions within a session were pre- 
sented according to some predetermined random order which varied 
for different sessions. Also, the speech materials for crosstalk and pri- 
mary conversation were recorded in such a way that the volume (in VU) 
was maintained at a fairly constant level across conversation segments. 


2.8 Subjects 


Thirty-one subjects, male and female, took part in Experiments I 
and IT. Their ages ranged from 20 to 64. They were selected at random 
from employees at the Murray Hill location of Bell Telephone Labora- 
tories. Six of these subjects had previous experience with psychoacoustic 
experiments; the rest had no such previous exposure. 

In Experiment ITI, 39 subjects took part. Fifteen of them were sub- 
jects also in Experiments I and II including the six experienced subjects 
mentioned above. 

The subjects were tested for hearing acuity before the experiments. 
All the subjects had about normal hearing in the range of 500-2000 Hz, 
considered important for speech intelligibility. 

In general, it may be said that in terms of their age, sex, professional 
background and hearing level, the subjects represent a reasonably good 
cross section of Bell System customers. 


III. RESULTS AND DISCUSSION 


3.1 Thresholds Data—Experiments I and II 


Figure 1 presents the group psychometric functions for detectability 
thresholds obtained from two experimental conditions providing the 
same amount of circuit noise. Curve a was obtained with a background 
noise of 18 dBrnC. Curve b was obtained with a background noise of 
18 dBrnC and also a primary speech level of —30 VU. Both noise and 
VU measurements were made at the line terminals of the subjects’ 
telephone set. The ordinate gives the percentage of the subjects de- 
tecting the crosstalk; the crosstalk volumes are plotted on the abscissa. 
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Fig. 1—Cumulative distributions of crosstalk detection, curves a and b refer to 
two experimental conditions: curve a, circuit noise 18 dBrnC; curve b, circuit noise 
18 dBrnC, primary speech —30 VU. All measurements were made at the terminals 
of the telephone set. 


The curves in Fig. 1 were drawn from the raw data. Similar detecta- 
bility and intelligibility threshold (of one word or more) functions were 
drawn for all the experimental conditions in Experiments I and II. Since 
these functions appeared similar to cumulative normal curves, the raw 
data for each experimental condition were subjected to an unweighted- 
normal least-squares fit. The Kolmogorov-Smirnov’ test was applied to 
determine any significant difference between the actual and the fitted 
cumulative normal curves. No difference was observed at the 5 percent 
level of significance. Group detectability and intelligibility thresholds 
were then obtained by finding the speech (or crosstalk) level correspond- 
ing to the 50 percent point on the fitted cumulative threshold function 
for each experimental condition. 

Group threshold for each experimental condition was also calculated 
from the raw data by simply taking the average of all the subjects’ 
individual thresholds for that condition as obtained from the Method 
of Limit. 
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A comparison between the threshold values of actual and fitted data 
for Experiments I and II is presented in Table I. Notice that the thresh- 
old values for corresponding experimental conditions are about the same. 
In Experiment I, two crosstalk sentences were used for each noise 
condition, one spoken by a male talker and the other by a female talker. 
In this table, they have been indicated by M and F respectively. The 
threshold values for these two sentences have been averaged for each 
noise condition since they were not significantly different. (In general, 
no significant difference in the threshold data was found between male 
and female talkers in any of the three experiments.) For Experiment IT, 
the table presents the threshold values for each of the 25 experimental 
conditions. For each noise condition, the threshold values for the five 
primary speech levels were also averaged. All intelligibility threshold 
values in Table I are for intelligibility of one word or more. 

Table II presents the standard deviation values corresponding to the 
mean thresholds of Table I as used for the least-squares normal fit. 
The data are presented for Experiment II only. On the average, varia- 
bility in intelligibility threshold was found to be much larger than in 
detectability threshold. 

For Experiment I, however, where there was no background speech 
as in Experiment II, variability in the threshold data was much lower 
and consistent over the range of noise levels used. For intelligibility 
threshold, standard deviation was of the order of 2.5 dB, and for de- 
tectability threshold, it was of the order of 2.0 dB. These values were 
used for the normal least-squares fit. 

For any noise level in Experiment II, notice the change in threshold 
as a function of primary speech level as shown in Fig. 2. For detecta- 
bility, no significant change in threshold values was observed over a 
20 dB range of primary speech level (from —380 VU to —50 VU) for 
the four high noise levels between 33.5 and 48.5 dBrnC. However, with 
the low noise level (that is, 18 dBrnC), a threshold difference of 8.5 dB 
was found between the lowest and the highest speech level. In the case 
of intelligibility, the corresponding threshold shifts were found to be 
much larger. But here again, as in the case of detectability threshold, 
the ranges of the threshold shifts were relatively smaller for higher noise 
levels, as compared to the one obtained for 18 dBrnC. 

Figure 3 presents the summary of the test results of Experiments I 
and II in terms of threshold as a function of circuit noise level. For 
Experiment IT, each data point represents the average of the five thresh- 
old values (corresponding to five primary speech levels) for each circuit 
noise condition. For Experiment I, each data point represents the 
average of the two threshold values (male and female talkers) for each 
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Fig. 2—Crosstalk threshold as a function of primary speech in the circuit. The 
different curves are for different values of circuit noise in dBrnC. 


circuit noise condition. Two curves have been drawn for each experi- 
ment, one for the detectability threshold and one for the intelligibility 
threshold. These threshold functions show two important character- 
istics: (z) they are linear for the high noise levels and show a tendency 
to bend at the lower noise levels, and (27) on the average, there is about 
a 10 dB shift between detectability threshold and intelligibility thresh- 
old. 
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g. 3—Crosstalk threshold as a function of circuit noise. A represents detecta- 
bilit’ ‘threshold; B, intelligibility threshold. 
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How do the threshold functions of Experiment I (with noise as 
background) compare with those of Experiment II (with both noise 
and primary speech as background)? Figure 4 presents this comparison. 
Two functions from each experiment have been presented, one for the 
detectability thresholds and one for the intelligibility thresholds. A 
very interesting finding comes out of this comparison: the detectability 
threshold function of Experiment II is about the same as the intelligi- 
bility threshold function of Experiment I. This suggests that crosstalk 
which is barely detectable in a circuit when people are talking becomes 
just intelligible when people pause or stop talking. Crosstalk objectives 
for the telephone plant are, however, based on threshold data obtained 
in the absence of any primary speech, that is, the kind of data obtained 
from Experiment I here. 


3.2 Comparison with Earlier Data 


Several other studies also have investigated the problem of masking 
of speech by noise. Unfortunately, due to lack of complete information, 
most of the previous data cannot be properly converted for precise 
comparison with the present data. However, there are two sets of data 
(Hawkins and Stevens’ and Edson*) which could be compared with the 
present data (Experiment I) with proper conversions. 

Figure 5 presents the comparison between Hawkins’ and Stevens’ data 
and those obtained from Experiment I. The dBrnC and VU readings of 
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_Fig. 4—Crosstalk threshold as a function of circuit noise. A represents detecta- 
bility threshold and B, the intelligibility threshold in Experiment I; C, the detecta- 
bility threshold and D, the intelligibility threshold in Experiment II. 
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Fig. 5—Speech threshold as a function of background noise: a comparison between 
the present data and Hawkins-Stevens data. 


the present data have been converted to noise and speech sound pressure 
levels respectively. 

A portion of the experimental setup used by Hawkins and Stevens 
is shown in Fig. 6. In general, three main differences can be pointed out 
between their experimental conditions and those in Experiment I: 
(1) They used a PDR-10 earphone having a flat response over a much 
wider frequency band than the U1 telephone receivers used in the present 
experiments. (72) They used a continuous passage as speech material 
whereas in Experiment I short sentences were used for the same purpose. 
(i7t) They used the Method of Adjustment, that is, the subjects them- 
selves adjusted the speech level and judged their own intelligibility 
threshold. 

In Experiment I, on the other hand, the Method of Limit was used; 
that is, the speech level was controlled by the experimenter and the 
intelligibility threshold was based on the number of correct words 
reproduced by the subjects. Also, Hawkins and Stevens used a small 
group of four trained subjects; whereas in Experiment I, a total of 31 
subjects were used. In spite of these differences, however, the agreement 
between the two sets of data is very good. On the average, corresponding 
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threshold values between the two sets of data differ by less than 2 dB. 

Edson’s 1952 data had to be corrected for proper comparison with the 
present data. The final comparison between Edson’s data and the 
present data is shown in Tig. 7. Both measurements are at the line ter- 
minals of a 500 type telephone set. The average difference between cor- 
responding threshold values in the two sets of data is of the order of 4 
dB here. It should be pointed out, however, that the present data points 
are for ‘‘one word or more intelligibility,’ whereas Edson’s data points 
are for “four words or more intelligibility.’”’ Assuming that these two 
criteria produce a difference of about 2 to 2.5 dB (this was generally 
observed in Experiment I), the average difference between Edson’s 1952 
data and the present data for corresponding thresholds turns out to be 
of the order of 2 dB. Considering the various differences between the 
two sets of experimental conditions, a difference of this size is quite 
probable. 

Experiment III was designed to check how much the results of Ex- 
periment I might differ by introducing a criterion for the intelligibility 
threshold which was not so well defined as in Experiment I and also by 
changing the criterion of intelligibility from ‘‘one word or more” to 
“about a sentence” in a continuous crosstalk situation. The subjects 
themselves adjusted the level of crosstalk for the threshold and used 
their own judgment to decide about both detectability and intelligi- 
bility thresholds. Both intelligibility and detectability thresholds were 
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Fig. 6—Block diagram of the apparatus used for the measurement of pure tone 
ial in the quiet and in the presence of white masking noise. (From ’Hawkins- 
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Fig. 7—Crosstalk intelligibility threshold as a function of noise. Note: Data 
points for noise levels below 18 dBrnC were taken from six trained subjects only 
in Sen’s experiment. 


found to be higher in Experiment III than their corresponding values in 
Experiment I. The average differences were 2.0 dB for intelligibility 
threshold, and 3.1 dB for detectability threshold. Actual differences 
were, however, larger for low noise levels than for high noise levels. It 
may be recalled that the threshold values in Experiment I are 50 
percent threshold values. The threshold: values of Experiment III 
compare with 80-90 percent threshold values for corresponding condi- 
tions in Experiment I. In other words, while using the Method of Ad- 
justment, the subjects preferred to be more than 50 percent confident 
in making their threshold settings. The average standard deviation was 
found to be 2.8 dB as compared to 2.5 dB in Experiment I. A comparison 
between the results of Experiments I and III is shown in Table III. 


3.3 Crosstalk Thresholds for Flat and Capacitive Coupling Systems 


While considering the use of the present data (from Experiment I) 
for setting transmission objectives, it should be remembered that the 
experiments reported here were performed using only flat crosstalk 
coupling between adjacent channels. The data are, therefore, directly 
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applicable to carrier systems.* A legitimate question, however, arises 
concerning the applicability of these data for the voice frequency systems 
in the lower frequency range where the coupling loss between adjacent 
channels is reduced by 6 dB per octave because of capacitive coupling. 

To find out the difference in crosstalk intelligibility thresholds be- 
tween the two above-mentioned cases, that is, flat and capacitive cross- 
talk coupling between adjacent channels, an experiment was recently 
performed by Koenig’ using both males and females as crosstalk sources. 
It was found that the capacitive coupling system was, on the average, 
2.0 dB more sensitive than the flat coupling system for male crosstalk 
and 1.06 dB more sensitive for female crosstalk. To be on the conserva- 
tive side, therefore, it is reeommended that in setting crosstalk objec- 
tives for the voice frequency systems using the present data from Ex- 
periment I, the obtained intelligibility thresholds should be lowered 
by 2.0 dB. 


IV. SUMMARY AND CONCLUSIONS 


This paper describes three recently performed laboratory experi- 
ments on crosstalk thresholds and presents the results. The experiments 
were performed using simulated telephone conversations. Detectability 
and intelligibility thresholds of crosstalk were obtained from the sub- 
jects. Thirty-one subjects were used in Experiments I and II, and 39 
in Experiment III. Fifteen of these subjects took part in all three ex- 
periments. The subjects were chosen from among employees at the 
Murray Hill location of Bell Telephone Laboratories. Most of them 
had no previous experience in subjective tests of transmission quality. 

Experiment II used both primary speech and circuit noise as masking 
stimuli while for Experiment I circuit noise was the only masking stim- 
ulus. The same five noise conditions were used in both experiments. The 
primary speech in Experiment II appeared in five levels. In both ex- 
periments, the experimenter controlled all levels of speech and noise. 
The subjects were required to indicate the presence and absence of 
crosstalk and reproduce the crosstalk words heard whenever they were 
intelligible. Short sentences spoken by both male and female talkers 
were used as crosstalk material. 

Experiment III was in a way, a repeat of Experiment I with two 
major exceptions: (2) A continuous simulated telephone conversation 
instead of short sentence was used as crosstalk material. (iz) The subjects 


* Because the coupling loss between adjacent channels is effectively flat or inde- 
pendent of frequency. 


TABLE IJJ—A ComPparRIsSON BETWEEN THE RESULTS OF EXPERIMENTS I & III 


M 
F 


Avg. 


Avg. 


Experiment I. Crosstalk Material: Short Beranek Sentences 
Intelligibility Threshold Detectibility Threshold 


NOISE LEVEL IN DBRNC 
18 33.5 38.5 43.5 48.5 18 33.5 38.5 43.5 48.5 


75.8 —62.8 -—59.5 -—50.2 -—48.2 -—82.2 -—72.3 -—-67.7 —61.3 —55.0 
—77.2 —60.2 -—54.1 —52.7 -44.2 -—85.0 —-72.8 -—66.4 -62.0 —55.2 


—76.5 —61.5 —56.8 -—51.4 -46.1 -—83.6 -—72.5 -—67.0 -—61.6 —55.1 


Experiment III. Crosstalk Material: Simulated Conversations. 
Intelligibility Threshold Detectibility Threshold 


NOISE LEVEL IN DBRNC 
18 33.5 38.5 43.5 48.5 18 33.5 38.5 43.5 48.5 


—73.3 -—59.6 —55.4 -—51.0 -45.3 -—79.8 -—67.6 -—62.1 -—58.0 ~—53.4 
—72.1 -—58.4 ~—54.1 -—50.8 -45.0 -80.1 -—68.5 -—64.0 -60.5 —55.2 


—72.7 -—59.0 -—54.8 -—50.6 —-45.1 —79.9 -—68.0 -63.0 —59.2 -—54.3 
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themselves controlled the crosstalk volume for obtaining thresholds. 
The criterion for intelligibility threshold was ‘‘about one sentence being 
understood.” 

In general, the results obtained from Experiments I and III agree 
fairly well with similar data published earlier. For circuit noise levels 
above 25 dBrnC measured at the line terminals of a 500-type telephone 
set, the crosstalk threshold increased almost linearly with noise. In the 
range of 10 to 25 dBrnC, the “threshold versus noise function” was 
found to be nonlinear. For low noise (below 10 dBrnC) levels, the thresh- 
old was found to be almost independent of noise, that is, the slope of the 
“threshold versus noise function” is almost zero. The data for low noise 
levels below 10 dBrnC were obtained from a supplementary experiment 
using six of the trained subjects. 

In Experiment IT, where primary speech was also introduced into the 
circuit, the ‘threshold versus noise function” was also approximately 
linear for high-noise level. No data were collected for low-noise level. 
It was also found in this experiment that a 20 dB shift in the primary 
speech level between —30 and —50 VU did not produce a significant 
change in the crosstalk threshold; the main variable affecting the thresh- 
old was noise. The five threshold values, corresponding to the five 
primary speech levels, were therefore averaged for each of the five noise 
conditions. These values were found to be approximately 10 dB higher 
than the corresponding values obtained in Experiment I where no pri- 
mary speech was used. Within each experiment, the intelligibility thresh- 
old values were approximately 10 dB higher than the corresponding 
detectability threshold values. Also for the same amount of noise, the 
detectability threshold in the presence of speech was about the same as 
the intelligibility threshold in the absence of speech. 

In terms of actual threshold values, the present data from Experi- 
ment I agreed extremely well with similar data published by Hawkins 
and Stevens when proper transformations were carried out. Exact 
transformation of Edson’s data for comparison with the present data 
could not be done for lack of certain information. So the best possible 
transformation based on available information was carried out. Com- 
parison of the threshold values for “four words or more’ intelligibility 
showed a difference of the order of 2 dB between Edson’s 1952 data and 
the present data. Considering that there were several differences in the 
experimental conditions, the latter difference seems quite reasonable. 
Comparison with any other data on similar studies was not possible 
because enough information was not available for proper transformation 
of those data. 
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The intersubject variability in the present data was found to be rather 
small, the average standard deviation being of the order 2.5 dB. This 
figure agrees very well with variability figures published by Falconer 
and Davis for similar experiments.*° Most other authors did not supply 
any figures for intersubject variability but in a paper summarizing the 
results of masking of speech experiments Miller mentioned that in ex- 
periments of this type, the variability between subjects is usually very 
small.” 

Finally, there is one suggestion about the criterion of intelligibility 
threshold that should be considered in setting transmission objectives 
for crosstalk. Intelligibility of ‘four words or more’’ has generally been 
used. Based on the small variability of the present data as discussed in 
the preceding paragraph, it is however suggested that a more stringent 
criterion, that is, intelligibility of ‘‘one word or more” should be seriously 
considered. While analyzing the results of the present experiments it — 
was observed that when one word became easily intelligible, quite a few 
other words were also intelligible with a high frequency, except in rare 
cases where one particular word was considerably louder than the 
average speech level. 
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APPENDIX A 


A.l Apparatus Used in Experiments I and II 


The laboratory setup for Experiments I and II is shown in Fig. 8 
in the form of a block diagram. A 2-channel tape recorder (A) served 
‘as the stimulus source, one channel providing the primary speech in 
Experiment II and the other channel providing crosstalk. A second tape 
recorder (B) was used for playing the six anchor conditions. The outputs 
from the 2-channel tape recorder were passed through two 600 w at- 
tenuators, one for each channel, into a 600 w mixing pad (C). A white 
noise generator was connected to one port of this mixing pad through a 
1 : 1 bridging coil and a 600 w attenuator designated as NS. The output 
of this mixing pad was connected to a standard 500-type telephone set 
through a McIntosh 10 watt program amplifier (No. 2), a 10-dB pad 
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Fig. 8—Laboratory system for crosstalk Experiments I and IT. 


and a battery supply circuit providing 50 milliamps of current to the 
telephone set. The transmitter of the telephone set was replaced by a 
90 w resistor and the receiver was connected to 12 other receivers in 
parallel by means of a bridging arrangement comprising 2 resistors 
(5,600 w each), a transformer, and another McIntosh 10 watt program 
amplifier (No. 1). The purpose of this amplifier was to equate the signal 
level at each of the 12 receivers with that in the standard receiver. 
Each one of the 12 parallel receivers (with the associated handset) was 
located in a separate booth thus permitting testing 12 subjects at a time. 


A.2 Apparatus Used in Experiment III 


The laboratory setup for Experiment III is shown in Fig. 9. This sys- 
tem is a simple version of the one shown in Fig. 8. A tape recorder was 
used for the crosstalk source. The attenuator termed SUBJECT was 
a 600 w continuously variable attenuator which the subject used for 
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Fig. 9—Laboratory system for crosstalk Experiment III. 


adjusting the crosstalk speech level. The attenuators termed EXP 
and NS were 600 w attenuators which were under the control of the 
experimenter. The 600 w mixing pad (C) was retained in the circuit so 
that primary speech could also be introduced if wanted. When no such 
primary speech was used, one port was terminated with a 600 w resistor. 
The output of the mixing pad (C) was passed through a similar mixing 
pad (D) one side of which was connected to a white noise generator 
through a 600 » attenuator termed NS and a 1 : 1 bridging coil since the 
noise generator was unbalanced. 


A.3 Frequency Response of the Experimental System 


Figure 10 presents the frequency response curve of the experimental 
system used in Experiments I and II. A graphic level recorder was used 
to plot this electrical to acoustic response of the system. The output of 
the oscillator was fed to channel A attenuator as shown in Fig. 8. Both 
A and B attenuators were set at high values and the input to the noise 
attenuator was terminated in 600 w. Figure 10 shows the result from 
receiver No. 6 which had the average sound pressure level of all the 12 
recelvers used in the experiments. Results from other receivers were 
similar. The level recorder was plugged into the recorder jack of a 
B&K amplifier. The calibration was made at 1000 Hz point to cor- 
respond to the sound pressure level obtained for No. 6 receiver. The 
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frequency response of the system used in Experiment III was found to 
be similar. 


A.4 Calibration Data of the Experimental System 


Table IV presents the calibration data for the laboratory system used 
in Experiments I and II. A calibration tape was used for the bridging 
and terminated measurements. The input to the noise attenuator was 
terminated in 600 w and A&B attenuators were set at 0 dB. 


A.5 Receiver Calibration 


Table V presents the receiver calibration data in terms of dB SPL 
values. The sound pressure levels (SPL in dB) of the receivers used in 


TasB_Le [TV—1000 Cycie CALIBRATION FIGURES FOR THE LABORATORY 
SysteM SHOWN IN FIGURE 8 


Location in the System 600 w Termination* Bridging* 
ay —7 dBot —12 dBO 
Be —7 dBO —12 dBO 
b —18 dBO —18 dBO 
c +2.5 dBO +2.5 dBO 
d —7.5 dBO —7.5 dBO 
e —_ —19.5 dBO 
f —46 dBO —45.5 dBO 
g —_— —19 dBO — 


* A VU-meter was used to measure the levels of the 1000 Hz tone. 
t dBO corresponds to .775 volt. 
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TABLE V—RECEIVER CALIBRATION DATA 


Receiver No. dB SPL 
1 101. 

2 102 

3 102. 

4 103. 

5 102. 

6 102. 

7 102. 

8 103. 

9 102. 

10 102. 

11 102. 

12 102. 
Standard Receiver 103. 


WOONONA NOOO 


Note: The overall 250-3000 Hz variation of all the receivers relative to the stand- 


ard 


receiver was within + 1 dB. 


Experiments I and II were determined by using an Artificial Ear system. 
A 1000 Hz calibration tone was used. Its level was —7.5 dBo at the 
point d in Fig. 8. The attenuators A and B were set to zero and the noise 
input was terminated in 600 w. The standard receiver refers to the one 
shown in Fig. 8. 
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Charge Coupled Semiconductor Devices 


By W.S. BOYLE and G. E. SMITH 
(Manuscript received January 29, 1970) 


In this paper we describe a new semiconductor device concept. Basically, 
it consists of storing charge in potential wells created at the surface of a 
semiconductor and moving the charge (representing information) over the 
surface by moving the potential minima. We discuss schemes for creating, 
transferring, and detecting the presence or absence of the charge. 

In particular, we consider minority carrier charge storage at the Si- 
S70, interface of a MOS capacitor. This charge may be transferred to a 
closely adjacent capacitor on the same substrate by appropriate manipula- 
tion of electrode potentials. Examples of possible applications are as a 
shift register, as an imaging device, as a display device, and in performing 
logic. 


A new semiconductor device concept has been devised which shows 
promise of having wide application. The essence of the scheme is to 
store minority carriers (or their absence) in a spatially defined deple- 
tion region (potential well) at the surface of a homogeneous semi- 
conductor and to move this charge about the surface by moving the 
potential minimum. A variety of functions can then be performed by 
having a means of generating or injecting charge into the potential 
well, transferring this charge over the surface of a semiconductor, and 
detecting the magnitude of the charge at some location. One method 
of producing and moving the potential wells is to form an array of 
conductor-insulator-semiconductor capacitors and to create and move 
the potential minima by applying appropriate voltages to the con- 
ductors. The purpose of this paper is to describe the operation of this 
basic structure and some possible applications. We present calculations 
which show feasibility for a simple silicon-silicon dioxide MOS structure. 

First consider a single MIS structure on an n-type semiconductor. 
A diagram of energy vs. distance is shown in Fig. 1 for an applied 
voltage difference V, in which the metal is negative with respect to 
the semiconductor and large enough to cause depletion. When the 
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Fig. 1—A plot of electron energy vs distance through an MIS structure both with 
(at time £ = o) and without (at time ¢ = 0) charge stored at the surface. 


voltage is first applied at ¢ = 0, there are no holes at the semiconductor- 
insulator interface and the voltage is divided between the semiconductor 
and insulator as shown. If holes are introduced into the depletion 
region by some means, they will collect at the semiconductor interface 
causing the interface potential to become more positive. Eventually 
the situation shown in Fig. 1 fort = © is reached. This is the steady 
state condition for the structure and it occurs when the valance band 
at the interface is approximately at the same energy as the Fermi level 
Ey in the bulk. Any further introduction of holes will cause the inter- 
face potential to become yet more positive and holes will be injected 
into the bulk until the steady state condition is again reached. 

Now, consider the linear array of MIS structures on an n-type 
semiconductor as shown in Fig. 2 where every third electrode is con- 
nected to a common conductor. As an initial condition, a voltage —V, 
is applied to electrodes 1, 4, 7, and so on, and a voltage —V, (V2 > V;) 
is applied to the other electrodes. The semiconductor is held at zero 
potential and the V,’s are taken as positive numbers. It is assumed 
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that V; > Vy, where V- is the threshold voltage for the production 
of inversion under steady state conditions. The edge of the depletion 
region is indicated by the dashed line. Also, as an example, positive 
charge is placed under electrodes 1 and 7 and none under electrode 4, 
as indicated in Fig. 2(a). Now a voltage —V3; (V3 > V2) is applied to 
electrodes 2, 5, 8, and so on, as shown in Fig. 2(b) and the charge will 
transfer from electrode 1 to the potential minimum under electrode 2, 
and so on. The voltages are now changed to the condition of Fig. 2(c) 
and, as shown, charge has been shifted one spatial position and the 
sequence is ready to be continued. 

It has been assumed in the foregoing that the voltages were applied 
and manipulated in a time shorter than the storage time 7 where rt = 
Q/TI, is the time for the thermally generated current J; to supply the 
equilibrium charge density Q. The thermal current J, results from 
generation-recombination centers in the depletion region and at the 
semiconductor-insulator interface. Storage times of the order of seconds 
have been reported.’~* 

It is of interest now to consider the capacitance and surface potential 
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Fig. 2—Schematic of a three phase MIS charge coupled device. 
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of the structure as a function of stored charge. The capacitance can 
be used as a measure of the stored charge. Knowledge of the surface 
potential is necessary to design a structure that insures complete 
transfer of charge since, referring to Fig. 2, as charge flows from electrode 
1 to electrode 2 the potential of 1 will fall and the potential of 2 will 
rise. Clearly the voltages V; and V, must be chosen such that the surface 
potential at electrode 2 is always lower. The steady state minority 
carrier density Q per unit area for a given gate voltage Vg is given by 
Q = Cy)(Ve — Vr) where Cy = Koe/Xo is the oxide capacitance, K, 
is the oxide dielectric constant, and X, the thickness. For a charge 
density Q’ S Q, the potential y, at the semiconductor surface can be 
shown to be 


Casa ves “ (Vex 


Efe Meta talfs —g (ee re) 
(1) 


where B = K,qgNpX_/Ko, K, is the silicon dielectric constant, V pz 
is the flatband voltage and Np the donor density. Similarly, the ca- 
pacitance between gate and substrate can be shown to be 


200V eg Q’ Vo — Ver "s 

ee ol oR E ~Q ie r) |} | ” 
These quantities are plotted as a function of Q’/Q in Fig. 3 for a rep- 
resentative structure with Vr = 1.2V. The depletion width X, = 
(2K.¢.€0/qN p)’ is also plotted. It is seen that these quantities are a 
reasonably strong function of Q’/Q for the parameters chosen. In a 
practical situation, the gate voltages chosen (~10V) are readily at- 
tainable from silicon integrated circuits. 

There are two interrelated quantities of interest in describing the 
transfer of charge from one electrode to the next. One is the time to 
transfer the charge and the other is the transfer efficiency which we 
define as the fraction of charge transferred from one electrode to the 
next. The time constant for transfer of charge from one electrode to 
another by diffusion will be of the order 7, = L’/4D where L is the 
linear dimension of the electrode and D the diffusion constant. It is 
assumed that the spacings and the applied voltages are such that no 
potential barrier exists between the electrodes. For L = 107° cm and 
D = 10 em’/sec, it is found that r> = 2.5 X 10° sec. The amount 
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Fig. 3—A theoretical plot of depletion width (Xa), surface potential (y,) and ca- 
pacitance (C) of an MIS structure as a function of charge at the interface (Q’). 
Edge effects are neglected. The values used in this calculation were: 

Va = 100; 
Xo = 2 X 10-5cm; 
5 X 10/cm;; 
1.7 X 10-8F /cm?. 
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of charge remaining will decay in an almost exponential manner with 
this time constant if trapping in deep surface and bulk states is neglected. 
If trapping times are comparable to any transfer times of interest, 
such effects will also detract from the transfer efficiency and for the 
current Si-SiO, technology, it appears that surface states will be the 
limiting factor. 

There will also be a field enhanced component resulting from the 
change of surface potential with charge density. A qualitative under- 
standing of this is obtained by considering the situation in Fig. 2(b) 
immediately after —V; has been applied but before charge has trans- 
ferred from electrode 1 to electrode 2. As charge from the right hand 
edge of electrode 1 flows into the potential well under electrode 2, 
the potential at that edge will become more negative by an amount 
given by equation (1). This effect results in a field parallel to the inter- 
face which adds to the diffusion component. This field will propagate 
back under the electrode and decrease in magnitude as charge flows 
but will always add to the diffusion component. The exact nature of 
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this field has not been calculated but its effect is expected to be signifi- 
cant. For example, an average potential drop of 0.1 volts across the 
width of a 107° cm electrode will result in a transit time of 2.5 X 107° 
sec. assuming a mobility of 400 cm?/v-sec. Further field enhancement 
may be obtained by making the electrode width plus interelectrode 
spacing comparable to the oxide thickness and using the fringing field 
of the neighboring electrode. 

The structure in Fig. 2 may be used as a shift register with the addi- 
tion of a charge generator at one end (input) and a detector at the 
other. The generation can be accomplished by a forward biased p-n 
junction, by surface avalanching in an MOS structure,* or by radiation 
induced pair creation. Detection may be accomplished by current 
detection with a reverse biased p-n junction or Schottky barrier or by 
utilizing the change of capacitance with charge [see equation (2)]. 

An estimate of the basic signal-to-noise limitations can be made by 
considering detection by a reversed biased diode put in place of the 
last electrode and connected to ground by a resistor. If Q is the average 
amount of charge stored in an element and f the transfer frequency, 
then the average signal current is simply J, = Qf. For the example 
given in Fig. 2, Q ~ 10~* C for an electrode with an area of 10~° em’. 
This results in a signal of 107’ amperes at one megacycle. State of 
the art video amplifiers have an equivalent noise of about 107° amperes 
at one megacycle and would dominate the shot noise which for this 
example is 2 X 107*° amperes. 

The basic shift register concept may be used to construct a recirculat- 
ing memory or used as a delay line for times up to the storage time. 
Clearly, charge transfer in two dimensions is possible as well as the 
ability to perform logic. An imaging device may be made by having a 
light image incident on the substrate side of the device creating electron- 
hole pairs. The holes will diffuse to the electrode side where they can 
be stored in the potential wells created by the electrodes. After an 
appropriate integration time, the information may be read out via 
shift register action. A display device’ may be constructed by the 
inverse process of reading in the information (minority carriers) via 
shift register action and then forward biasing the MIS structure to 
force the minority carriers into the bulk where radiation recombination 
takes place. 

Aside from problems of yield, the limit to the usefulness device will 
be determined largely by the speed of transfer, the fractional amount 
of charge not transferred, and the thermal discharge current. Pre- 
liminary experiments’ show that for existing silicon technology, these 
parameters lie within the range of usefulness. 
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Experimental Verification of the Charge Coupled 
Device Concept 


By G. F. AMELIO, M. F. TOMPSETT and G. E. SMITH 
(Manuscript received February 5, 1970) 


Structures have been fabricated consisting of closely spaced MOS ca- 
pacitors on an n-type silicon substrate. By forming a depletion region 
under one of the electrodes, minority carriers (holes) may be stored in 
the resulting potential well. This charge may then be transferred to an 
adjacent electrode by proper manipulation of electrode potentials. The 
assumption that this transfer will take place in reasonable times with a 
small fractional loss of charge is the basis of the charge coupled devices 
described in the preceding paper.’ To test this assumption, devices were 
fabricated and measurements made. Charge transfer efficiencies greater 
than 98 percent for transfer times less than 100 nsec were observed. 


The basic principles of the charge coupled device, as already de- 
scribed,’ are very simple indeed, but it is not clear whether the properties 
of an MIS system are adequate to give viable devices. The purpose 
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of this paper is to describe experiments which have been carried out 
using the silicon-silicon dioxide system to investigate these properties 
and their effect on device performance in terms of charge transfer 
speed and efficiency. 

The requirements on the silicon-silicon dioxide interface and on the 
oxide itself are very demanding. One essential feature is a long storage 
time which is the time required for a pulsed MOS element to reach 
the steady state condition. The storage time is a function of the flat- 
band voltage, the pulse voltage and the number of generation-re- 
combination centers at the interface and in the neighboring bulk. 
Tgnoring bulk states and using the capacitance of a 1200 A thick oxide, 
it is readily calculated that for zero threshold voltage, a pulse voltage 
of 20 V and the surface recombination current’ * of 3.7 X 107° A em™ 
appropriate to a fast state density of 2 X 10*’° states/cm’, the storage 
time is about 16 seconds. 

The operational requirement of a charge coupled device is that it 
must be able to transfer charge with only minimal loss at high speeds. 
The object of our experiments has been to evaluate this. Estimates of the 
rate of charge transfer have been made’ but estimates of transfer 
efficiency are much more speculative on account of ambiguity in the 
density of surface states in the energy region near the band edge for a 
particular oxide. 

Several types of oxide on nominal 10 Q-cm n-type (100) and (111) 
orientated silicon have been tried. Steam grown oxides with a fast 
surface state density as low as Ns, = 2 X 10°° states/em’ gave oxide 
storage times less than 100 msecs for a 20 V pulse. This unexpected 
result was attributed to generation-recombination centers caused by 
impurities which had diffused into the bulk. A silane deposited oxide 
had storage times greater than one second but was not stable with 
respect to migration of positive charge. The oxide which has given the 
best results so far is a dry oxide 1200 A thick grown in oxygen at 1100°C 
for one hour and annealed in a nitrogen atmosphere for one hour at 
400°C. The flatband potential for this oxide is typically —5 V. 

The initial device configuration used in the experiments described 
below is a linear array of Cr-Au squares 0.1 X 0.1 mm and separated 
by 3 wm gaps. These squares were produced by conventional photo- 
lithography on the oxidized silicon slice. The slice was diced, each 
die mounted on a 10 pin header and each square gold-wire bonded to 
a pin. 

The device as described above was designed principally for ease of 
fabrication and is in no way optimized in either material processing 
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or geometry. Indeed, there are reasons for supposing that p-type 
material might be preferable since the minority carrier mobility will 
be greater than in n-type silicon. 

Evaluation of charge coupled device performance is based on the 
measurement of several parameters including percentage of charge 
transferred (efficiency), the limiting speed of transfer and the storage 
time. For times greater than about one-half second, the latter property 
is easily measured by applying a negative step voltage and observing 
the change of capacitance with time using a capacitance bridge and an 
xy recorder. Storage times less than one-half second are normally 
associated with high interface state density oxides or a large number 
of bulk generation-recombination centers and are of no interest in the 
present application. 

Observation of charge transfer including the determination of ef- 
ficiency and speed requires a different approach. The experimental 
configuration chosen in the measurements is shown in Fig. (1). Ca- 
pacitor P, in this figure is used to supply a source of holes to the other 
units (P,, P., ---) by surface avalanching. The avalanching pulse, 
is adjustable 0-200 volts with a full width half maximum. of 60 nano- 
seconds. For the 10 Q-cm substrate material and 1200 A oxide thick- 
ness used, avalanching occurs in the vicinity of —165 volts. Unit 
pulse generators are attached to pads P,, P., and P;. In a many 
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Fig. 1—Schematic of experimental configuration used to evaluate charge transfer, 
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transfer application, P, is attached to each P,,3;,, P2 attached to each 
P.12, and P; attached to each P3,3,.’ The substrate is connected to 
a load resistor and a positive potential for the purpose of biasing the 
MOS elements beyond threshold voltage. The output signal is ca- 
pacitively coupled to a relatively low impedance so that response times 
on the order of 100 nanoseconds are achieved. As each MOS capacitor 
is pulsed by the supply generators, a charging and discharging spike 
is observed at the oscilloscope which, for the circuit shown, is propor- 
tional to the current flow. The pulsing sequence for capacitors P, , 
P, and P, is illustrated in Fig. (2) for the conditions when the P, 
and P, pulse voltages (Vp, and Vp,) do and do not overlap in time. 
Note the avalanche pulse occurs shortly after P, is turned on. Of 
interest is the charge transfer from P, to P, , all others being ignored 
for the sake of simplicity. Below each pulse sequence is shown the 
expected (idealized) oscilloscope display with a positive going signal 
taken in the downward direction. 

For the nonoverlap condition, there are two essentially separate 
events. Notice that the turn-off pulse of P, is larger than the turn-on 
pulse when avalanching of P, occurs during the on-time of P,. This 
is easily understood. Each current pulse is given by the relation 

: dQ dQ dV dV 

WS ar ap Oo a (1) 
where c(V) is the differential capacitance of the device, V is the voltage 
across the capacitor and Q is the charge flowing from ground. Assuming 
the turn-on and turn-off characteristics of each voltage pulser are made 
the same, the magnitude of the current is determined by the differential 
capacitance c(V). At turn-on, the capacitance which must be charged 
to an additional V, volts from the bias voltage V, is represented by 
the oxide and depletion capacitance in series. When Py is avalanched, 
the holes generated diffuse to P, and invert the surface there. The 
depletion region under P, diminishes and the associated capacitance 
increases. Now at turn-off when the voltage across the device is returned 
to V,, the relaxation pulse is of greater magnitude than the turn-on 
pulse by an amount related to the change in differential capacitance. 
When no holes are stored, as in the case of P, , the turn-on and turn-off 
pulses are of equal amplitude. 

Consider now the overlap case. There, instead of the turn-off pulse 
of P, resulting in a large hole injection into the bulk, the holes are 
transmitted to the adjacent MOS capacitor. The turn-off pulse am- 
plitude of P, should therefore decrease. On the other hand, the turn-off 
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Fig. 2—The pulsing sequence for capacitors Po, P: and P2. Below each pulse 
sequence is shown the expected (idealized) oscilloscope display with positive going 
signal taken in the downward direction. 


pulse of P, is expected to increase as a result of the charge transmitted 
to it from P, . 
The efficiency of a single charge transfer can be defined as 


charge arriving at P, 
~ charge originally stored in P, 


(2) 


where the charge is given by the integral from V, to V, -+ V, of the 
difference in differential capacitance during turn-off and turn-on. This 
charge can be approximately related to the current pulses discussed 
above if equal voltage pulses and similar MOS capacitance properties 
for the two pads are assumed. Thus, for bias voltages significantly 
beyond threshold where the c(V) curve is relatively flat, the efficiency 
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Fig. 3—Oscilloscope traces showing the (a) nonoverlap and (b) overlap charging 
ee for an actual device with V; = —5V and V, = —20V. The time base is 
2 ws/cm. 


can be reasonably approximated in terms of the peak amplitudes of 
the relaxation current pulses as 


wegehea <- I, 
aaa ae as I, (3) 


where J,, is the turn-off pulse when P, contains charge, J,, is the turn- 
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off pulse when P, contains charge and /, is the turn-off pulse when 
either is empty. 

In Figs. 3(a) and (b), the nonoverlap and overlap charging pulses 
for an actual device with V, = — 5 V and V, = — 20 V are given. 
The threshold voltage for this unit is —1.5 volts. The evidence of 
charge transport is unmistakable. In Fig. 4 a similar, although somewhat 
more complicated, photograph shows the superposition of many events 
(using a storage oscilloscope) in which the pulse duration of Vp, is 
increased until it overlaps Vp, by one microsecond. Following this, 
V pe is additionally delayed until there is once again no overlap. The 
rounding seen in the turn-off pulse of P, after it goes out of overlap 
is attributable to holes remaining in the vicinity of P, and P, after 
P, is turned off. The high transfer speed of the device is seen by the 
rapidity with which the relaxation pulse P, falls off as the pulses overlap. 
Although not evident in Fig. 2, the charge transfer efficiency is not 
a function of time for overlap times greater than 100 nanoseconds (the 
rise time of the pulses used in the experiment). Using enlarged photo- 
graphs similar to that shown in Fig. 3 and equation (3), the measured 
efficiency in 7 = 94 + 6 percent. Measurements made in this manner 
have been performed on devices with wet, dry and deposited oxides 
on (111) and (100) oriented surfaces. To date, the best results have 





Fig. 4—Oscilloscope traces showing the superposition of many events (using a 
storage oscilloscope) in which the pulse duration of Vp, is increased from 4 us until 
it overlaps Vp, by one microsecond. The turn-on of Vp, is then additionally delayed 
until there is once again no overlap. The same device is used as for Fig. 3. 
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been obtained for a 1200 A dry oxide on the (100) surface of silicon. 

More recently, multiple transfer measurements have been conducted 
for which efficiencies greater than 90 percent have been demonstrated 
after five transfers, again with pulse widths of 3 us and overlap times 
of 1 ws. This implies an 7 of over 98 percent. For these measurements, 
current integration has been employed for more accurate determination 
of the charge transferred. 

The authors wish to acknowledge the help of R. A. Furnanage in 
fabricating the devices and the assistance of P. M. Ryan and E. J. 
Zimany, Jr. in making the measurements. 
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